2019-12-11T13:24:50.003 INFO:root:teuthology version: 1.0.0-9fd7768 2019-12-11T13:24:50.004 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.rSrnDX.tmp -- --verbose --lock --description rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi --block --owner scheduled_abhi@teuthology --archive /home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200 2019-12-11T13:24:50.051 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-11T13:24:50.107 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200 branch: wip-abhi-testing-2019-12-04-1433 description: rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: null first_in_suite: false job_id: '4585200' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-abhi-testing-2019-12-04-1433 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b rgw: compression type: random ec-data-pool: false frontend: civetweb storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-abhi-testing-2019-12-04-1433 sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b owner: scheduled_abhi@teuthology priority: 99 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b suite: rgw suite_branch: wip-abhi-testing-2019-12-04-1433 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: public-access-qa git_remote: git://github.com/theanalyst/ rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2491 2019-12-11T13:24:50.108 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa; will attempt to use it 2019-12-11T13:24:50.108 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa/tasks 2019-12-11T13:24:50.109 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-11T13:24:50.111 INFO:teuthology.task.internal:Checking packages... 2019-12-11T13:24:50.130 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '827e03c8a6b1e17d93dcaf79724437bac291c35b' 2019-12-11T13:24:50.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-11T13:24:50.131 INFO:teuthology.packaging:ref: None 2019-12-11T13:24:50.131 INFO:teuthology.packaging:tag: None 2019-12-11T13:24:50.131 INFO:teuthology.packaging:branch: wip-abhi-testing-2019-12-04-1433 2019-12-11T13:24:50.131 INFO:teuthology.packaging:sha1: 827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:24:50.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-abhi-testing-2019-12-04-1433 2019-12-11T13:24:50.295 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7936.g827e03c 2019-12-11T13:24:50.295 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-11T13:24:50.308 INFO:teuthology.task.internal:no buildpackages task found 2019-12-11T13:24:50.308 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-11T13:24:50.346 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-11T13:24:50.346 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-11T13:24:50.397 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_abhi@teuthology', 'description': '/home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200', 'machine_type': 'smithi'} 2019-12-11T13:24:50.412 DEBUG:teuthology.lock.ops:locked ubuntu@smithi150.front.sepia.ceph.com, ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:24:50.474 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-11T13:24:50.715 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 7.6 2019-12-11T13:24:50.730 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 7.6 2019-12-11T13:24:51.055 INFO:teuthology.orchestra.console:Power off smithi150 2019-12-11T13:24:51.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-11T13:24:51.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:24:51.117 INFO:teuthology.orchestra.console:Power off smithi073 2019-12-11T13:24:51.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-11T13:24:51.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:24:55.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:24:55.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:24:59.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:24:59.282 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:03.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:03.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:03.584 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2019-12-11T13:25:03.602 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2019-12-11T13:25:03.685 INFO:teuthology.orchestra.console:Power on smithi150 2019-12-11T13:25:03.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-11T13:25:03.703 INFO:teuthology.orchestra.console:Power on smithi073 2019-12-11T13:25:03.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-11T13:25:03.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:03.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:07.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:07.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:08.108 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2019-12-11T13:25:08.209 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2019-12-11T13:25:12.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-11T13:25:12.228 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2019-12-11T13:25:12.329 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2019-12-11T13:27:54.634 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:27:58.681 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:03.691 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:07.754 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:12.750 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:16.810 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:21.806 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:25.866 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:30.863 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:34.922 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:39.914 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:43.978 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:48.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:53.033 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:28:58.027 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:02.089 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:07.085 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:26.572 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:35.633 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:44.493 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:44.713 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:44.723 INFO:teuthology.orchestra.run.smithi073:> hostname 2019-12-11T13:29:44.936 INFO:teuthology.orchestra.run.smithi150:> hostname 2019-12-11T13:29:45.272 INFO:teuthology.orchestra.run.smithi073.stdout:smithi068 2019-12-11T13:29:45.272 INFO:teuthology.orchestra.run.smithi073:> grep smithi068 /etc/hosts 2019-12-11T13:29:45.314 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-12-11T13:29:45.315 INFO:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2019-12-11T13:29:45.412 INFO:teuthology.orchestra.run.smithi150.stdout:smithi068 2019-12-11T13:29:45.413 INFO:teuthology.orchestra.run.smithi150:> grep smithi068 /etc/hosts 2019-12-11T13:29:45.461 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-12-11T13:29:45.461 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2019-12-11T13:29:45.462 INFO:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi068/smithi073/g' /etc/hosts 2019-12-11T13:29:45.530 INFO:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.68/172.21.15.73/g' /etc/hosts 2019-12-11T13:29:45.560 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi068/smithi150/g' /etc/hosts 2019-12-11T13:29:45.593 INFO:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi068/smithi073/g' /etc/hostname 2019-12-11T13:29:45.623 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.68/172.21.15.150/g' /etc/hosts 2019-12-11T13:29:45.646 INFO:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2019-12-11T13:29:45.678 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi068/smithi150/g' /etc/hostname 2019-12-11T13:29:45.697 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2019-12-11T13:29:45.699 DEBUG:teuthology.parallel:result is None 2019-12-11T13:29:45.733 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2019-12-11T13:29:45.784 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2019-12-11T13:29:45.786 DEBUG:teuthology.parallel:result is None 2019-12-11T13:29:45.922 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2019-12-11T13:29:45.923 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-11T13:29:45.939 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2019-12-11T13:29:45.939 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-11T13:29:45.956 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2019-12-11T13:29:45.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:29:45.957 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:46.027 INFO:teuthology.orchestra.run.smithi073:> true 2019-12-11T13:29:46.322 INFO:teuthology.orchestra.run.smithi073:> uname -m 2019-12-11T13:29:46.363 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2019-12-11T13:29:46.364 INFO:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2019-12-11T13:29:46.442 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Linux" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="7 (Core)" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="7" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-11T13:29:46.443 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.centos.org/" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-11T13:29:46.444 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-11T13:29:46.445 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-11T13:29:46.445 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:46.446 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2019-12-11T13:29:46.459 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2019-12-11T13:29:46.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:29:46.460 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:46.526 INFO:teuthology.orchestra.run.smithi150:> true 2019-12-11T13:29:46.782 INFO:teuthology.orchestra.run.smithi150:> uname -m 2019-12-11T13:29:46.823 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2019-12-11T13:29:46.823 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2019-12-11T13:29:46.862 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Linux" 2019-12-11T13:29:46.862 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="7 (Core)" 2019-12-11T13:29:46.862 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="7" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-11T13:29:46.863 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.centos.org/" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-11T13:29:46.864 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:29:46.865 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2019-12-11T13:29:46.895 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-11T13:29:46.921 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+kCjYzStMcZG5+0HmKr26w9M8yIoMd3nbjCB4TFRPHHtWbJtWFFwWREtycm+ZQ9kt8gXPAZrI1ygLX9Zf775GLi5QAZddZavc1MJC2B/WNO/lR684Yw36L67TM/khtICvbdztyVGuhhcmIsCfVTEoj2OLVEUpoc4qXkwVFXglqSkSsqVaFrkD12MI1E1VT0IsN90Rfwy/iYbOTlmI3nHQ3HlpKBlARip+U+uodi4dNPF0Ji7k2o9KUAfL01a42eImfm5B8XWy9T1Z+WqZFIvHXxIlnVpGENnRsJdyqUKsMmKNxubr9EnQlsTyGJLaPbKSK0slvS+JubIIsyiw+Crd smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwd/pYxGspvqS0N5DyDJa0xx2YV1AE40TgasnczDGz55cc9RIyvC4mVpimyUGIzMxp9P8k4FiTJyOZxie3oxYVKAaVm2b9gQ7pwLL2EQDLaDugvI7motMDKQjRprR5Py0Zwb8KdVcBFQo80xmPuQ3TLgjDiy6s1Z/A+mdVcatEaNL3fx3LFnq/sUS54dtnwNRCMwokXLjIImfA0R/pkPrrzfeK56KQ2lVFW7Zmbfl981aRyuQG3fvGy2vchtbvlR5IQuLmmNgouKqhZ7X1HMzZFzK63TGy1qFhcSx8w4n9NYWBP5MT7vc/GwRKu6HtMFhm4wvgyvQ7ZRBwt1slMmHR 2019-12-11T13:29:46.921 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-11T13:29:46.963 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-11T13:29:46.972 INFO:teuthology.task.internal:Saving configuration 2019-12-11T13:29:46.990 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-11T13:29:47.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-11T13:29:47.014 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-11 13:24:50.404129', u'locked_by': u'scheduled_abhi@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi073.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXU26QU22EL5TqUkRSkXSTyRMm4A18AWX7EBC13445Z5Ged8rHdh9/5q7ftl3zQmC6qpb1JFuasF8jcl5Wipdw=', u'description': u'/home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200'} 2019-12-11T13:29:47.028 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-11 13:24:50.404110', u'locked_by': u'scheduled_abhi@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi150.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwNNf/MG233VvwZleoBhMaWD5r6XA26CJoTtem7JX2g8WrsWtfICyKz9tyVupG3NjRXfu66fjHdOL1bU62ct4A=', u'description': u'/home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200'} 2019-12-11T13:29:47.028 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-11T13:29:47.038 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-11T13:29:47.039 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-11T13:29:47.039 INFO:teuthology.run_tasks:Running task console_log... 2019-12-11T13:29:47.104 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-11T13:29:47.105 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-11T13:29:47.116 INFO:teuthology.task.internal:Opening connections... 2019-12-11T13:29:47.116 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:29:47.118 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:47.186 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:29:47.187 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:29:47.254 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-11T13:29:47.302 INFO:teuthology.orchestra.run.smithi073:> uname -m 2019-12-11T13:29:47.396 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2019-12-11T13:29:47.396 INFO:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2019-12-11T13:29:47.436 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Linux" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="7 (Core)" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="7" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-11T13:29:47.437 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.centos.org/" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-11T13:29:47.438 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-11T13:29:47.439 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-11T13:29:47.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:47.439 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2019-12-11T13:29:47.454 INFO:teuthology.orchestra.run.smithi150:> uname -m 2019-12-11T13:29:47.516 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2019-12-11T13:29:47.516 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Linux" 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="7 (Core)" 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="7" 2019-12-11T13:29:47.557 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.centos.org/" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-11T13:29:47.558 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-11T13:29:47.559 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-11T13:29:47.559 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-11T13:29:47.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:29:47.559 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2019-12-11T13:29:47.574 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-11T13:29:47.615 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-11T13:29:47.631 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-11T13:29:47.631 INFO:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2019-12-11T13:29:47.634 INFO:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2019-12-11T13:29:47.677 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-11T13:29:47.719 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-11T13:29:47.719 INFO:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2019-12-11T13:29:47.721 INFO:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2019-12-11T13:29:47.768 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-11T13:29:47.809 INFO:teuthology.run_tasks:Running task kernel... 2019-12-11T13:29:47.827 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-11T13:29:47.827 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-11T13:29:47.828 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:29:47.828 INFO:teuthology.orchestra.run.smithi073:> sudo package-cleanup -y --oldkernels 2019-12-11T13:29:48.672 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:29:50.443 INFO:teuthology.orchestra.run.smithi073.stdout:No old kernels to remove 2019-12-11T13:29:50.455 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:29:50.456 INFO:teuthology.orchestra.run.smithi150:> sudo package-cleanup -y --oldkernels 2019-12-11T13:29:51.276 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:29:53.519 INFO:teuthology.orchestra.run.smithi150.stdout:No old kernels to remove 2019-12-11T13:29:53.532 INFO:teuthology.orchestra.run.smithi073:> uname -r 2019-12-11T13:29:53.622 INFO:teuthology.orchestra.run.smithi073.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:29:53.623 INFO:teuthology.task.kernel:Running kernel on smithi073: 3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:29:53.623 INFO:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2019-12-11T13:29:53.820 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:29:53.856 INFO:teuthology.orchestra.run.smithi073.stdout:Determining fastest mirrors 2019-12-11T13:29:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:29:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: ftp.linux.ncsu.edu 2019-12-11T13:29:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:29:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:29:56.030 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:29:56.030 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:29:56.031 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-11T13:29:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:29:59.157 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:59.157 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:29:59.166 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:59.166 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:29:59.166 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:29:59.166 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T13:29:59.167 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:29:59.168 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 50 M 2019-12-11T13:29:59.168 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 64 M 2019-12-11T13:29:59.168 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:29:59.172 INFO:teuthology.orchestra.run.smithi073.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-11T13:30:00.386 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:30:00.578 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:30:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:30:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:30:35.875 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-11T13:30:36.408 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-11T13:30:36.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:30:36.408 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:30:36.408 INFO:teuthology.orchestra.run.smithi073.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-11T13:30:36.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:30:36.409 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:30:36.479 INFO:teuthology.orchestra.run.smithi073:> rpm -q kernel --last | head -n 1 2019-12-11T13:30:36.882 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Wed 11 Dec 2019 01:30:04 PM UTC 2019-12-11T13:30:36.886 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:30:36.886 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:30:36.886 INFO:teuthology.orchestra.run.smithi150:> uname -r 2019-12-11T13:30:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:30:37.020 INFO:teuthology.task.kernel:Running kernel on smithi150: 3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:30:37.020 INFO:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2019-12-11T13:30:37.324 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:30:37.368 INFO:teuthology.orchestra.run.smithi150.stdout:Determining fastest mirrors 2019-12-11T13:30:37.566 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:30:37.567 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: ftp.linux.ncsu.edu 2019-12-11T13:30:37.568 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:30:37.568 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.rackspace.com 2019-12-11T13:30:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:30:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:30:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-11T13:30:41.312 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:30:42.192 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:30:42.193 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:30:42.193 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:30:42.193 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:30:42.194 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:30:42.195 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2019-12-11T13:30:42.195 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:30:42.195 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 50 M 2019-12-11T13:30:42.195 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 64 M 2019-12-11T13:30:42.196 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:30:42.204 INFO:teuthology.orchestra.run.smithi150.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-11T13:30:43.226 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:30:43.405 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:30:44.273 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:30:44.273 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:31:19.190 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-11T13:31:19.742 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-11T13:31:19.742 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:31:19.742 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:31:19.742 INFO:teuthology.orchestra.run.smithi150.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-11T13:31:19.743 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:31:19.743 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:31:19.794 INFO:teuthology.orchestra.run.smithi150:> rpm -q kernel --last | head -n 1 2019-12-11T13:31:20.185 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Wed 11 Dec 2019 01:30:47 PM UTC 2019-12-11T13:31:20.187 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:20.187 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:20.187 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-11T13:31:20.188 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-11T13:31:20.188 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-11T13:31:20.188 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-11T13:31:20.188 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2019-12-11T13:31:20.188 INFO:teuthology.orchestra.run.smithi073:> rpm -q kernel --last | head -n 1 2019-12-11T13:31:20.553 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Wed 11 Dec 2019 01:30:04 PM UTC 2019-12-11T13:31:20.554 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:20.555 INFO:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2 2019-12-11T13:31:20.694 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2 2019-12-11T13:31:20.694 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2019-12-11T13:31:20.694 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.02 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 0.76.el7.centos 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:Group : System Environment/Base 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 0 2019-12-11T13:31:20.695 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Relocations : (not relocatable) 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : CentOS BuildSystem 2019-12-11T13:31:20.696 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-11T13:31:20.697 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-11T13:31:20.698 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2019-12-11T13:31:20.698 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-11T13:31:20.699 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:20.699 INFO:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-11T13:31:21.117 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2019-12-11T13:31:21.239 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:21.252 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-11T13:31:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:31:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-11T13:31:21.609 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-11T13:31:21.628 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-11T13:31:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-11T13:31:21.668 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-11T13:31:22.896 INFO:teuthology.orchestra.run.smithi073.stderr:done 2019-12-11T13:31:22.897 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:31:22.949 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.NUDiPdYeRf 2019-12-11T13:31:22.949 INFO:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NUDiPdYeRf 2019-12-11T13:31:23.017 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.NUDiPdYeRf 2019-12-11T13:31:23.180 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.NUDiPdYeRf is 6KB 2019-12-11T13:31:23.247 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.NUDiPdYeRf 2019-12-11T13:31:23.298 INFO:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 0 2019-12-11T13:31:23.456 INFO:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2019-12-11T13:31:23.462 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-11T13:31:23.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2019-12-11T13:31:23.462 INFO:teuthology.orchestra.run.smithi150:> rpm -q kernel --last | head -n 1 2019-12-11T13:31:23.796 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Wed 11 Dec 2019 01:30:47 PM UTC 2019-12-11T13:31:23.798 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:23.798 INFO:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2 2019-12-11T13:31:23.908 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.02 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 0.76.el7.centos 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Group : System Environment/Base 2019-12-11T13:31:23.909 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 0 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Relocations : (not relocatable) 2019-12-11T13:31:23.910 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : CentOS BuildSystem 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-11T13:31:23.911 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-11T13:31:23.912 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-11T13:31:23.912 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2019-12-11T13:31:23.913 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-11T13:31:23.913 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:23.913 INFO:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-11T13:31:24.361 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2019-12-11T13:31:24.522 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:31:24.538 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-11T13:31:24.773 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-11T13:31:24.794 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-11T13:31:24.824 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-11T13:31:24.844 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-11T13:31:24.871 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-11T13:31:24.879 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-11T13:31:25.983 INFO:teuthology.orchestra.run.smithi150.stderr:done 2019-12-11T13:31:25.984 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:31:26.044 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.6jtKXALPmP 2019-12-11T13:31:26.045 INFO:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6jtKXALPmP 2019-12-11T13:31:26.120 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.6jtKXALPmP 2019-12-11T13:31:26.243 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.6jtKXALPmP is 6KB 2019-12-11T13:31:26.294 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.6jtKXALPmP 2019-12-11T13:31:26.347 INFO:teuthology.orchestra.run.smithi150:> sudo grub2-set-default 0 2019-12-11T13:31:26.569 INFO:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2019-12-11T13:31:26.573 INFO:teuthology.misc:Re-opening connections... 2019-12-11T13:31:26.573 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:31:26.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:31:26.574 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:32:26.576 DEBUG:teuthology.orchestra.remote:timed out 2019-12-11T13:32:26.576 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:32:26.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:32:26.577 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:01.240 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2019-12-11T13:33:01.241 DEBUG:teuthology.misc:waited 94.6678781509 2019-12-11T13:33:02.241 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:33:02.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:02.242 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:05.304 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2019-12-11T13:33:05.305 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:33:05.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:05.305 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:08.376 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2019-12-11T13:33:08.377 DEBUG:teuthology.misc:waited 101.803774118 2019-12-11T13:33:09.377 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:33:09.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:09.378 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:12.440 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2019-12-11T13:33:12.441 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:33:12.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:12.441 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:13.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2019-12-11T13:33:13.910 DEBUG:teuthology.misc:waited 107.336954117 2019-12-11T13:33:14.911 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:33:14.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:14.912 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:14.913 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2019-12-11T13:33:14.914 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:33:14.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:14.914 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:14.915 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2019-12-11T13:33:14.915 DEBUG:teuthology.misc:waited 108.342251062 2019-12-11T13:33:15.915 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:33:15.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:15.916 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:15.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2019-12-11T13:33:15.917 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:33:15.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:15.918 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:16.008 INFO:teuthology.orchestra.run.smithi150:> true 2019-12-11T13:33:16.374 DEBUG:teuthology.misc:waited 109.80095005 2019-12-11T13:33:17.375 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:33:17.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:33:17.376 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:33:17.452 INFO:teuthology.orchestra.run.smithi073:> true 2019-12-11T13:33:17.773 DEBUG:teuthology.misc:waited 111.200050116 2019-12-11T13:33:18.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-11T13:33:18.774 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-11T13:33:18.774 INFO:teuthology.orchestra.run.smithi073:> uname -r 2019-12-11T13:33:18.848 INFO:teuthology.orchestra.run.smithi073.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:33:18.848 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:33:18.848 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-11T13:33:18.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-11T13:33:18.849 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-11T13:33:18.849 INFO:teuthology.orchestra.run.smithi150:> uname -r 2019-12-11T13:33:18.908 INFO:teuthology.orchestra.run.smithi150.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:33:18.909 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-11T13:33:18.909 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-11T13:33:19.909 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-11T13:33:19.910 INFO:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-11T13:33:19.999 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2019-12-11T13:33:20.017 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-11T13:33:20.017 INFO:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-11T13:33:20.083 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2019-12-11T13:33:20.096 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-11T13:33:20.106 INFO:teuthology.task.internal:Creating test directory... 2019-12-11T13:33:20.106 INFO:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-11T13:33:20.112 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-11T13:33:20.158 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-11T13:33:20.179 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-11T13:33:20.194 INFO:teuthology.task.internal:Creating archive directory... 2019-12-11T13:33:20.195 INFO:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-11T13:33:20.199 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-11T13:33:20.252 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-11T13:33:20.266 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-11T13:33:20.266 INFO:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-11T13:33:20.269 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-11T13:33:20.323 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-11T13:33:20.326 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-11T13:33:20.329 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-11T13:33:20.346 INFO:teuthology.task.internal:Configuring sudo... 2019-12-11T13:33:20.347 INFO:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-11T13:33:20.354 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-11T13:33:20.410 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-11T13:33:20.523 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-11T13:33:20.524 INFO:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-11T13:33:20.528 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-11T13:33:20.567 INFO:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-11T13:33:20.665 INFO:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-11T13:33:20.734 INFO:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-11T13:33:20.791 INFO:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-11T13:33:20.871 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-11T13:33:20.926 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-11T13:33:20.985 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-11T13:33:21.052 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-11T13:33:21.108 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-11T13:33:21.160 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-11T13:33:21.223 INFO:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2019-12-11T13:33:21.226 INFO:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2019-12-11T13:33:21.320 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-11T13:33:21.337 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-11T13:33:21.359 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-11T13:33:21.371 INFO:teuthology.task.internal:Starting timer... 2019-12-11T13:33:21.372 INFO:teuthology.run_tasks:Running task pcp... 2019-12-11T13:33:21.411 INFO:teuthology.run_tasks:Running task selinux... 2019-12-11T13:33:21.428 INFO:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2019-12-11T13:33:21.520 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: [ OK ] 2019-12-11T13:33:21.522 INFO:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2019-12-11T13:33:21.629 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: [ OK ] 2019-12-11T13:33:21.630 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-11T13:33:21.630 INFO:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2019-12-11T13:33:21.676 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2019-12-11T13:33:21.677 INFO:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2019-12-11T13:33:21.721 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2019-12-11T13:33:21.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2019-12-11T13:33:21.722 INFO:teuthology.orchestra.run.smithi073:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-11T13:33:21.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-11T13:33:21.776 INFO:teuthology.orchestra.run.smithi150:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-11T13:33:21.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-11T13:33:21.832 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-11T13:33:21.832 INFO:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2019-12-11T13:33:21.891 INFO:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2019-12-11T13:33:21.956 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-11T13:33:21.971 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-11T13:33:21.972 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-11T13:33:21.990 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-11T13:33:21.992 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-11T13:33:22.396 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-11T13:33:23.681 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-11T13:33:26.290 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-11T13:33:26.313 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:26 +0000 (0:00:00.068) 0:00:00.068 **** 2019-12-11T13:33:26.326 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:26 +0000 (0:00:00.012) 0:00:00.081 **** 2019-12-11T13:33:29.158 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi073.front.sepia.ceph.com] 2019-12-11T13:33:29.250 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:29 +0000 (0:00:02.924) 0:00:03.005 **** 2019-12-11T13:33:29.470 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2019-12-11T13:33:29.558 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:29 +0000 (0:00:00.308) 0:00:03.313 **** 2019-12-11T13:33:29.587 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-11T13:33:29.588 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-11T13:33:29.625 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:29 +0000 (0:00:00.066) 0:00:03.380 **** 2019-12-11T13:33:29.879 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-11T13:33:29.939 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:29 +0000 (0:00:00.313) 0:00:03.694 **** 2019-12-11T13:33:30.342 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-11T13:33:30.342 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-11T13:33:30.393 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:30 +0000 (0:00:00.453) 0:00:04.148 **** 2019-12-11T13:33:30.400 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-11T13:33:30.438 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:30 +0000 (0:00:00.045) 0:00:04.193 **** 2019-12-11T13:33:30.443 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-11T13:33:30.443 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:30.481 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:30 +0000 (0:00:00.042) 0:00:04.236 **** 2019-12-11T13:33:30.496 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:30.527 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:30 +0000 (0:00:00.046) 0:00:04.283 **** 2019-12-11T13:33:30.923 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-11T13:33:30.924 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:33:30.977 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:30 +0000 (0:00:00.449) 0:00:04.733 **** 2019-12-11T13:33:30.985 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:33:31.037 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:31 +0000 (0:00:00.059) 0:00:04.792 **** 2019-12-11T13:33:32.639 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071211.06-232482299998831/source", "state": "file", "uid": 0} 2019-12-11T13:33:32.681 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:32 +0000 (0:00:01.644) 0:00:06.436 **** 2019-12-11T13:33:32.688 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071210.99-260666848747525/source", "state": "file", "uid": 0} 2019-12-11T13:33:32.728 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:32 +0000 (0:00:00.046) 0:00:06.483 **** 2019-12-11T13:33:33.233 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-11T13:33:33.234 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:33.268 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:33.511 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:33.585 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:33.846 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:33.961 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.141 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.295 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.448 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.586 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.775 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:34.941 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:35.118 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:35.220 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-11T13:33:35.323 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-11T13:33:35.327 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-11T13:33:35.519 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:35 +0000 (0:00:02.783) 0:00:09.266 **** 2019-12-11T13:33:35.544 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:35 +0000 (0:00:00.033) 0:00:09.300 **** 2019-12-11T13:33:36.454 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi073.front.sepia.ceph.com] 2019-12-11T13:33:36.516 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2019-12-11T13:33:36.562 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-11T13:33:36.562 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:36 +0000 (0:00:01.017) 0:00:10.317 **** 2019-12-11T13:33:36.636 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:36 +0000 (0:00:00.073) 0:00:10.391 **** 2019-12-11T13:33:37.103 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-11T13:33:37.104 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.252620", "end": "2019-12-11 13:33:37.060878", "rc": 0, "start": "2019-12-11 13:33:36.808258", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2019-12-11T13:33:37.145 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.509) 0:00:10.900 **** 2019-12-11T13:33:37.152 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.279760", "end": "2019-12-11 13:33:37.099671", "rc": 0, "start": "2019-12-11 13:33:36.819911", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2019-12-11T13:33:37.205 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.060) 0:00:10.960 **** 2019-12-11T13:33:37.475 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011185", "end": "2019-12-11 13:33:37.443208", "failed_when_result": false, "rc": 0, "start": "2019-12-11 13:33:37.432023", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-11T13:33:37.519 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.314) 0:00:11.275 **** 2019-12-11T13:33:37.546 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-11T13:33:37.548 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016071", "end": "2019-12-11 13:33:37.525501", "failed_when_result": false, "rc": 0, "start": "2019-12-11 13:33:37.509430", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-11T13:33:37.587 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.064) 0:00:11.339 **** 2019-12-11T13:33:37.619 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.035) 0:00:11.374 **** 2019-12-11T13:33:37.625 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-11T13:33:37.625 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.663 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.044) 0:00:11.418 **** 2019-12-11T13:33:37.669 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-11T13:33:37.670 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.708 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.044) 0:00:11.463 **** 2019-12-11T13:33:37.715 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-11T13:33:37.716 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.753 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.045) 0:00:11.509 **** 2019-12-11T13:33:37.759 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-11T13:33:37.760 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.805 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.051) 0:00:11.560 **** 2019-12-11T13:33:37.811 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-11T13:33:37.811 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.849 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.044) 0:00:11.604 **** 2019-12-11T13:33:37.860 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.898 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.048) 0:00:11.653 **** 2019-12-11T13:33:37.904 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-11T13:33:37.907 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.947 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.049) 0:00:11.702 **** 2019-12-11T13:33:37.956 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:37.994 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:37 +0000 (0:00:00.047) 0:00:11.750 **** 2019-12-11T13:33:38.020 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-11T13:33:38.022 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:33:38.057 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:38 +0000 (0:00:00.062) 0:00:11.812 **** 2019-12-11T13:33:38.254 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:33:38.297 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:38 +0000 (0:00:00.239) 0:00:12.051 **** 2019-12-11T13:33:38.368 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:33:38.404 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:33:38 +0000 (0:00:00.108) 0:00:12.160 **** 2019-12-11T13:33:38.681 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-11T13:33:38.681 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-11T13:33:38.739 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-11T13:33:39.014 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-11T13:33:39.016 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-11T13:33:39.272 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-11T13:33:39.317 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-11T13:33:39.594 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-11T13:33:39.616 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-11T13:33:39.936 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-11T13:33:39.948 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-11T13:33:40.217 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-11T13:33:40.295 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-11T13:33:40.556 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-11T13:33:40.667 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-11T13:33:40.923 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-11T13:33:40.976 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-11T13:33:41.272 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-11T13:33:41.325 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-11T13:33:41.603 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-11T13:33:41.656 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-11T13:33:41.945 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-11T13:33:42.314 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140B 2019-12-11T13:33:42.314 INFO:teuthology.task.ansible.out:NGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-11T13:33:42.653 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-11T13:33:42.961 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-11T13:33:42.994 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-11T13:33:43.281 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-11T13:33:43.335 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-11T13:33:43.559 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXv 2019-12-11T13:33:43.560 INFO:teuthology.task.ansible.out:SKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-11T13:33:43.680 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-11T13:33:43.882 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-11T13:33:44.042 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-11T13:33:44.229 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-11T13:33:44.368 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-11T13:33:44.579 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-11T13:33:44.684 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-11T13:33:44.906 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-11T13:33:44.995 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-11T13:33:45.266 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-11T13:33:45.324 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-11T13:33:45.601 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-11T13:33:45.666 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-11T13:33:45.931 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-11T13:33:45.981 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-11T13:33:46.234 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-11T13:33:46.309 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-11T13:33:46.561 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-11T13:33:46.651 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-11T13:33:46.880 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-11T13:33:46.965 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-11T13:33:47.122 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-11T13:33:47.308 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-11T13:33:47.425 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-11T13:33:47.634 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-11T13:33:47.716 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-11T13:33:47.972 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-11T13:33:48.052 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-11T13:33:48.288 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-11T13:33:48.401 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-11T13:33:48.633 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-11T13:33:48.749 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-11T13:33:48.971 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-11T13:33:49.077 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-11T13:33:49.270 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-11T13:33:49.375 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-11T13:33:49.566 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-11T13:33:49.703 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-11T13:33:49.903 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-11T13:33:49.957 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-11T13:33:50.263 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-11T13:33:50.296 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-11T13:33:50.568 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-11T13:33:50.648 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-11T13:33:50.918 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-11T13:33:50.993 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-11T13:33:51.252 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-11T13:33:51.328 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-11T13:33:51.588 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-11T13:33:51.638 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-11T13:33:51.883 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-11T13:33:52.010 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-11T13:33:52.212 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-11T13:33:52.334 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-11T13:33:52.512 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-11T13:33:52.608 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-11T13:33:52.854 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-11T13:33:52.970 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-11T13:33:53.192 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-11T13:33:53.311 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-11T13:33:53.542 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-11T13:33:53.616 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-11T13:33:53.885 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-11T13:33:53.919 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-11T13:33:54.179 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-11T13:33:54.264 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-11T13:33:54.515 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-11T13:33:54.600 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-11T13:33:54.870 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-11T13:33:54.922 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-11T13:33:55.204 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-11T13:33:55.268 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-11T13:33:55.534 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-11T13:33:55.546 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-11T13:33:55.819 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-11T13:33:55.840 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-11T13:33:56.120 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-11T13:33:56.143 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-11T13:33:56.437 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-11T13:33:56.469 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-11T13:33:56.749 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-11T13:33:56.823 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-11T13:33:57.101 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-11T13:33:57.144 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-11T13:33:57.368 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-11T13:33:57.494 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-11T13:33:57.638 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-11T13:33:57.853 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-11T13:33:57.937 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-11T13:33:58.196 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-11T13:33:58.248 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-11T13:33:58.548 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-11T13:33:58.614 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-11T13:33:58.859 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-11T13:33:58.941 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-11T13:33:59.184 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-11T13:33:59.269 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-11T13:33:59.536 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-11T13:33:59.609 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-11T13:33:59.885 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-11T13:33:59.948 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-11T13:34:00.241 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-11T13:34:00.274 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-11T13:34:00.566 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-11T13:34:00.578 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-11T13:34:00.879 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-11T13:34:00.935 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-11T13:34:01.195 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-11T13:34:01.301 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-11T13:34:01.543 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-11T13:34:01.654 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-11T13:34:01.890 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-11T13:34:01.985 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-11T13:34:02.221 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-11T13:34:02.329 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-11T13:34:02.592 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-11T13:34:02.688 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-11T13:34:02.911 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-11T13:34:03.046 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-11T13:34:03.223 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-11T13:34:03.401 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-11T13:34:03.548 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-11T13:34:03.758 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-11T13:34:03.895 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-11T13:34:04.130 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-11T13:34:04.245 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-11T13:34:04.479 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-11T13:34:04.588 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-11T13:34:04.815 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-11T13:34:04.942 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-11T13:34:05.155 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-11T13:34:05.273 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-11T13:34:05.495 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-11T13:34:05.601 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-11T13:34:05.835 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-11T13:34:05.956 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-11T13:34:06.170 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-11T13:34:06.288 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-11T13:34:06.524 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-11T13:34:06.599 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-11T13:34:06.866 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-11T13:34:06.940 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-11T13:34:07.224 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-11T13:34:07.291 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-11T13:34:07.566 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-11T13:34:07.620 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-11T13:34:07.882 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-11T13:34:07.967 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-11T13:34:08.212 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-11T13:34:08.321 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-11T13:34:08.553 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-11T13:34:08.698 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-11T13:34:08.908 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-11T13:34:09.040 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-11T13:34:09.276 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-11T13:34:09.417 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-11T13:34:09.627 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-11T13:34:09.800 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-11T13:34:09.931 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-11T13:34:10.130 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-11T13:34:10.260 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-11T13:34:10.460 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-11T13:34:10.622 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-11T13:34:10.795 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-11T13:34:10.984 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-11T13:34:11.139 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-11T13:34:11.342 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-11T13:34:11.477 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-11T13:34:11.689 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-11T13:34:11.815 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-11T13:34:12.030 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-11T13:34:12.149 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-11T13:34:12.374 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-11T13:34:12.479 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-11T13:34:12.727 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-11T13:34:12.855 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-11T13:34:13.083 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-11T13:34:13.207 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-11T13:34:13.558 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-11T13:34:13.754 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-11T13:34:13.917 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-11T13:34:14.300 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-11T13:34:14.464 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:14 +0000 (0:00:36.059) 0:00:48.219 **** 2019-12-11T13:34:14.493 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-11T13:34:14.529 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:14 +0000 (0:00:00.064) 0:00:48.284 **** 2019-12-11T13:34:14.578 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-11T13:34:14.579 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-11T13:34:14.581 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-11T13:34:14.585 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-11T13:34:14.586 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-11T13:34:14.588 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-11T13:34:14.589 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-11T13:34:14.591 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-11T13:34:14.592 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6c 2019-12-11T13:34:14.593 INFO:teuthology.task.ansible.out:GN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq 2019-12-11T13:34:14.595 INFO:teuthology.task.ansible.out:1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7 2019-12-11T13:34:14.597 INFO:teuthology.task.ansible.out:ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif" 2019-12-11T13:34:14.598 INFO:teuthology.task.ansible.out:, "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "o 2019-12-11T13:34:14.600 INFO:teuthology.task.ansible.out:vpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}]}, "changed": false} 2019-12-11T13:34:14.688 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:14 +0000 (0:00:00.159) 0:00:48.444 **** 2019-12-11T13:34:15.139 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-11T13:34:15.140 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-11T13:34:15.275 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:15 +0000 (0:00:00.586) 0:00:49.030 **** 2019-12-11T13:34:15.302 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-11T13:34:15.366 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:15 +0000 (0:00:00.091) 0:00:49.122 **** 2019-12-11T13:34:15.429 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-11T13:34:15.433 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-11T13:34:15.435 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-11T13:34:15.437 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-11T13:34:15.438 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-11T13:34:15.440 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", 2019-12-11T13:34:15.441 INFO:teuthology.task.ansible.out: "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": " 2019-12-11T13:34:15.443 INFO:teuthology.task.ansible.out:owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"n 2019-12-11T13:34:15.444 INFO:teuthology.task.ansible.out:ame": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": " 2019-12-11T13:34:15.446 INFO:teuthology.task.ansible.out:epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/ 2019-12-11T13:34:15.447 INFO:teuthology.task.ansible.out:g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd429 2019-12-11T13:34:15.449 INFO:teuthology.task.ansible.out:5278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mh 2019-12-11T13:34:15.450 INFO:teuthology.task.ansible.out:V8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}]}, "changed": false} 2019-12-11T13:34:15.505 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:15 +0000 (0:00:00.133) 0:00:49.255 **** 2019-12-11T13:34:15.678 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-11T13:34:15.685 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com -> localhost] => {"after": "c84d080fc97e482f88d240859322d5765ac90366", "attempts": 1, "before": "c84d080fc97e482f88d240859322d5765ac90366", "changed": false, "remote_url_changed": false} 2019-12-11T13:34:15.720 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:15 +0000 (0:00:00.220) 0:00:49.476 **** 2019-12-11T13:34:16.141 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-11T13:34:16.172 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-11T13:34:16.174 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com -> localhost] => {"after": "c84d080fc97e482f88d240859322d5765ac90366", "attempts": 1, "before": "c84d080fc97e482f88d240859322d5765ac90366", "changed": false, "remote_url_changed": false} 2019-12-11T13:34:16.228 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:16 +0000 (0:00:00.506) 0:00:49.983 **** 2019-12-11T13:34:16.465 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-11T13:34:16.465 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-11T13:34:16.641 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-11T13:34:16.823 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-11T13:34:17.018 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-11T13:34:17.154 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-11T13:34:17.359 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-11T13:34:17.516 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-11T13:34:17.518 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-11T13:34:17.688 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-11T13:34:17.836 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-11T13:34:18.028 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-11T13:34:18.029 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-11T13:34:18.194 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-11T13:34:18.196 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-11T13:34:18.368 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-11T13:34:18.538 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-11T13:34:18.720 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-11T13:34:18.722 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-11T13:34:18.894 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-11T13:34:18.906 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.087 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-11T13:34:19.260 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-11T13:34:19.263 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-11T13:34:19.272 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.283 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.298 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.440 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-11T13:34:19.451 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.681 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-11T13:34:19.810 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-11T13:34:19.811 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-11T13:34:19.826 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.837 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:19.849 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:20.029 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-11T13:34:20.030 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-11T13:34:20.173 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-11T13:34:20.399 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-11T13:34:20.521 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-11T13:34:20.522 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-11T13:34:20.756 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-11T13:34:20.887 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-11T13:34:21.093 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-11T13:34:21.239 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-11T13:34:21.458 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-11T13:34:21.565 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-11T13:34:21.794 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-11T13:34:21.889 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-11T13:34:22.156 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-11T13:34:22.221 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-11T13:34:22.484 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-11T13:34:22.485 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-11T13:34:22.582 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-11T13:34:22.827 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-11T13:34:22.865 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-11T13:34:22.950 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-11T13:34:22.952 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-11T13:34:23.181 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-11T13:34:23.291 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-11T13:34:23.292 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-11T13:34:23.543 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-11T13:34:23.629 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-11T13:34:23.863 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-11T13:34:23.865 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-11T13:34:23.941 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-11T13:34:24.235 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-11T13:34:24.278 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-11T13:34:24.280 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-11T13:34:24.577 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-11T13:34:24.632 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-11T13:34:24.925 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-11T13:34:24.972 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-11T13:34:25.302 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-11T13:34:25.325 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-11T13:34:25.661 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-11T13:34:25.683 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-11T13:34:26.010 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-11T13:34:26.074 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-11T13:34:26.076 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-11T13:34:26.373 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-11T13:34:26.374 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-11T13:34:26.418 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-11T13:34:26.747 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-11T13:34:26.790 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-11T13:34:27.050 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-11T13:34:27.150 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-11T13:34:27.350 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-11T13:34:27.491 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-11T13:34:27.638 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-11T13:34:27.839 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-11T13:34:27.967 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-11T13:34:28.200 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-11T13:34:28.296 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-11T13:34:28.297 INFO:teuthology.task.ansible.out: 2019-12-11T13:34:28.550 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-11T13:34:28.636 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-11T13:34:28.912 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-11T13:34:28.997 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-11T13:34:29.261 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-11T13:34:29.350 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-11T13:34:29.612 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-11T13:34:29.614 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-11T13:34:29.702 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-11T13:34:29.704 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-11T13:34:29.966 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-11T13:34:29.968 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-11T13:34:30.072 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-11T13:34:30.074 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-11T13:34:30.337 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-11T13:34:30.421 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-11T13:34:30.685 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-11T13:34:30.728 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-11T13:34:31.027 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-11T13:34:31.073 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-11T13:34:31.357 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-11T13:34:31.358 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-11T13:34:31.414 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-11T13:34:31.416 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-11T13:34:31.707 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-11T13:34:31.710 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-11T13:34:31.711 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-11T13:34:31.773 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-11T13:34:31.775 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-11T13:34:31.776 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-11T13:34:32.058 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-11T13:34:32.082 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-11T13:34:32.413 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-11T13:34:32.424 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-11T13:34:32.752 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-11T13:34:32.753 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-11T13:34:33.091 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-11T13:34:33.092 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-11T13:34:33.405 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-11T13:34:33.418 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-11T13:34:33.728 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-11T13:34:33.748 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-11T13:34:34.079 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-11T13:34:34.094 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-11T13:34:34.437 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-11T13:34:34.439 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-11T13:34:34.799 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-11T13:34:34.809 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, 2019-12-11T13:34:34.811 INFO:teuthology.task.ansible.out: "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2019-12-11T13:34:35.147 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-11T13:34:35.190 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-11T13:34:35.468 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-11T13:34:35.542 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-11T13:34:35.804 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-11T13:34:35.806 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-11T13:34:35.920 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-11T13:34:35.922 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-11T13:34:36.138 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-11T13:34:36.264 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-11T13:34:36.461 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-11T13:34:36.608 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-11T13:34:36.800 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-11T13:34:36.966 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-11T13:34:37.132 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-11T13:34:37.304 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-11T13:34:37.454 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-11T13:34:37.633 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-11T13:34:37.796 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-11T13:34:37.977 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-11T13:34:38.149 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-11T13:34:38.307 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-11T13:34:38.486 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-11T13:34:38.635 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-11T13:34:38.837 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-11T13:34:38.980 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-11T13:34:39.188 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-11T13:34:39.310 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-11T13:34:39.517 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-11T13:34:39.668 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-11T13:34:39.840 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-11T13:34:40.020 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-11T13:34:40.178 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-11T13:34:40.368 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-11T13:34:40.517 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-11T13:34:40.720 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-11T13:34:40.837 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-11T13:34:41.040 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-11T13:34:41.165 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-11T13:34:41.383 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-11T13:34:41.499 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-11T13:34:41.716 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-11T13:34:41.827 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-11T13:34:42.041 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-11T13:34:42.187 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-11T13:34:42.397 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-11T13:34:42.545 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-11T13:34:42.736 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-11T13:34:42.921 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-11T13:34:43.067 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-11T13:34:43.277 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-11T13:34:43.416 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-11T13:34:43.616 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-11T13:34:43.735 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-11T13:34:43.966 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-11T13:34:44.064 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-11T13:34:44.327 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-11T13:34:44.413 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-11T13:34:44.672 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-11T13:34:44.673 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-11T13:34:44.780 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-11T13:34:44.782 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-11T13:34:44.990 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-11T13:34:44.991 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-11T13:34:45.116 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-11T13:34:45.118 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-11T13:34:45.356 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-11T13:34:45.481 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-11T13:34:45.709 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-11T13:34:45.826 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-11T13:34:46.068 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-11T13:34:46.177 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-11T13:34:46.409 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-11T13:34:46.533 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-11T13:34:46.745 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-11T13:34:46.892 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-11T13:34:47.107 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-11T13:34:47.262 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-11T13:34:47.465 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-11T13:34:47.605 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-11T13:34:47.810 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-11T13:34:47.944 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-11T13:34:48.161 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-11T13:34:48.286 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-11T13:34:48.516 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-11T13:34:48.631 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-11T13:34:48.895 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-11T13:34:49.001 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-11T13:34:49.224 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-11T13:34:49.338 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-11T13:34:49.560 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-11T13:34:49.692 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-11T13:34:49.924 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-11T13:34:50.019 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-11T13:34:50.285 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-11T13:34:50.287 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-11T13:34:50.343 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-11T13:34:50.344 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-11T13:34:50.637 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-11T13:34:50.690 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-11T13:34:50.962 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-11T13:34:51.045 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-11T13:34:51.327 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-11T13:34:51.427 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-11T13:34:51.527 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:51 +0000 (0:00:35.299) 0:01:25.282 **** 2019-12-11T13:34:51.579 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:51 +0000 (0:00:00.051) 0:01:25.334 **** 2019-12-11T13:34:51.586 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-11T13:34:51.587 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.606 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.623 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.624 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.638 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.639 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.651 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.663 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.664 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.676 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.678 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.680 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.692 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.707 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.709 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:51.721 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:52.024 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-11T13:34:52.035 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:52.057 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-11T13:34:52.058 INFO:teuthology.task.ansible.out: 2019-12-11T13:34:52.070 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n" 2019-12-11T13:34:52.072 INFO:teuthology.task.ansible.out:}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:52.388 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-11T13:34:52.404 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-11T13:34:52.757 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-11T13:34:52.764 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-11T13:34:53.077 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-11T13:34:53.089 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.100 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-11T13:34:53.125 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.134 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.145 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.146 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.157 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.169 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.170 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.181 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.181 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.194 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.206 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.221 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.237 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.252 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33 2019-12-11T13:34:53.253 INFO:teuthology.task.ansible.out:ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.268 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Condition 2019-12-11T13:34:53.270 INFO:teuthology.task.ansible.out:al result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.281 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.282 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.295 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.297 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.308 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.309 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.319 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.320 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.322 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.333 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.334 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.345 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.355 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.358 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.367 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.369 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.372 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.380 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.381 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.396 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.397 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.413 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.415 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.424 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.426 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.427 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.432 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.442 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.464 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@l 2019-12-11T13:34:53.466 INFO:teuthology.task.ansible.out:aptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.475 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.476 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.488 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.488 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.501 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.502 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.515 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.516 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.527 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.528 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.549 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.550 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.560 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.561 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.562 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.575 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.575 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.577 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.598 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.599 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.612 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.613 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.615 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.625 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.627 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.628 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.630 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.641 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.643 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.655 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.656 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.668 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.668 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.670 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.681 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.691 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.703 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.704 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.705 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.707 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.717 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.717 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.719 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.729 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.730 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.745 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.746 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.758 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.759 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.760 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.774 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.785 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.787 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.788 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.789 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.799 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.800 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.812 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.813 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.826 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.827 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.828 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.840 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.841 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.853 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.865 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.866 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.867 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.878 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.880 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.881 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.891 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.892 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.893 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.905 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.906 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.917 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.917 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.919 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.941 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.943 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.955 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.957 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.959 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.973 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.983 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.984 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.986 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.996 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:53.997 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.008 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.008 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.010 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.020 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.021 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.022 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.034 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.034 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.036 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.049 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.060 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.061 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.062 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.073 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.114 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.115 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.172 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:54 +0000 (0:00:02.592) 0:01:27.927 **** 2019-12-11T13:34:54.212 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:54 +0000 (0:00:00.039) 0:01:27.967 **** 2019-12-11T13:34:54.219 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-11T13:34:54.221 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.262 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:54 +0000 (0:00:00.050) 0:01:28.017 **** 2019-12-11T13:34:54.268 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:34:54.306 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:34:54 +0000 (0:00:00.043) 0:01:28.061 **** 2019-12-11T13:34:54.613 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-11T13:34:54.615 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-11T13:34:54.709 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-11T13:34:54.975 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-11T13:34:55.028 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-11T13:34:55.300 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-11T13:34:55.354 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-11T13:34:55.626 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-11T13:34:55.714 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-11T13:34:55.944 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-11T13:34:56.071 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-11T13:34:56.271 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-11T13:34:56.396 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-11T13:34:56.611 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-11T13:34:56.752 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-11T13:34:56.939 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-11T13:34:57.103 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-11T13:34:57.281 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-11T13:34:57.451 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-11T13:34:57.588 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-11T13:34:57.788 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-11T13:34:57.902 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-11T13:34:58.134 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-11T13:34:58.257 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-11T13:34:58.466 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-11T13:34:58.598 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-11T13:34:58.828 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-11T13:34:58.923 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-11T13:34:59.147 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-11T13:34:59.245 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-11T13:34:59.463 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-11T13:34:59.579 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-11T13:34:59.803 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-11T13:34:59.921 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-11T13:35:00.166 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-11T13:35:00.264 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-11T13:35:00.495 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-11T13:35:00.581 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-11T13:35:00.833 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-11T13:35:00.898 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-11T13:35:01.185 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-11T13:35:01.243 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-11T13:35:01.514 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-11T13:35:01.820 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-11T13:35:02.082 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-11T13:35:02.364 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-11T13:35:02.637 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-11T13:35:02.960 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-11T13:35:03.241 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-11T13:35:03.541 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-11T13:35:03.826 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-11T13:35:04.076 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-11T13:35:04.380 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-11T13:35:04.691 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-11T13:35:04.928 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-11T13:35:05.316 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-11T13:35:05.505 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-11T13:35:05.893 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-11T13:35:06.056 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-11T13:35:06.417 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-11T13:35:06.564 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-11T13:35:06.973 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-11T13:35:07.143 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-11T13:35:07.554 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-11T13:35:07.669 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-11T13:35:08.068 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-11T13:35:08.267 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-11T13:35:08.407 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-11T13:35:08.594 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-11T13:35:08.743 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-11T13:35:08.933 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-11T13:35:09.041 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-11T13:35:09.276 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-11T13:35:09.350 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-11T13:35:09.610 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-11T13:35:09.695 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-11T13:35:09.940 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-11T13:35:10.011 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-11T13:35:10.275 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-11T13:35:10.360 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-11T13:35:10.624 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-11T13:35:10.953 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-11T13:35:11.030 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:11 +0000 (0:00:16.723) 0:01:44.785 **** 2019-12-11T13:35:11.145 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-11T13:35:11.219 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:11 +0000 (0:00:00.189) 0:01:44.974 **** 2019-12-11T13:35:12.184 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-11T13:35:12.186 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "checksum": "a4158e68ba2ebc4c7a2b2e8700cb6d232e28e006", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c98770ab2dfd6854e606863577b39ae3", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071311.06-63343181549520/source", "state": "file", "uid": 0} 2019-12-11T13:35:12.222 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:01.003) 0:01:45.978 **** 2019-12-11T13:35:12.249 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-11T13:35:12.251 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => { "msg": "Host smithi073.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-11T13:35:12.288 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.065) 0:01:46.043 **** 2019-12-11T13:35:12.324 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-11T13:35:12.325 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-11T13:35:12.361 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.073) 0:01:46.116 **** 2019-12-11T13:35:12.366 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-11T13:35:12.367 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "a4158e68ba2ebc4c7a2b2e8700cb6d232e28e006", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c98770ab2dfd6854e606863577b39ae3", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071311.25-170494738234970/source", "state": "file", "uid": 0} 2019-12-11T13:35:12.405 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.044) 0:01:46.161 **** 2019-12-11T13:35:12.412 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-11T13:35:12.414 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:12.449 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.043) 0:01:46.204 **** 2019-12-11T13:35:12.454 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-11T13:35:12.456 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => { "msg": "Host smithi150.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-11T13:35:12.492 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.042) 0:01:46.247 **** 2019-12-11T13:35:12.533 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-11T13:35:12.535 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-11T13:35:12.572 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.080) 0:01:46.327 **** 2019-12-11T13:35:12.609 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-11T13:35:12.611 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:12.668 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.093) 0:01:46.421 **** 2019-12-11T13:35:12.935 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-11T13:35:12.937 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.112094", "end": "2019-12-11 13:35:12.897453", "rc": 0, "start": "2019-12-11 13:35:12.785359", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-11T13:35:12.979 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:12 +0000 (0:00:00.313) 0:01:46.735 **** 2019-12-11T13:35:13.013 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-11T13:35:13.015 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.051 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.072) 0:01:46.807 **** 2019-12-11T13:35:13.078 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-11T13:35:13.080 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.132 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.080) 0:01:46.887 **** 2019-12-11T13:35:13.143 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-11T13:35:13.144 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.095853", "end": "2019-12-11 13:35:13.073015", "rc": 0, "start": "2019-12-11 13:35:12.977162", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-11T13:35:13.182 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.050) 0:01:46.938 **** 2019-12-11T13:35:13.189 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-11T13:35:13.190 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.248 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.064) 0:01:47.002 **** 2019-12-11T13:35:13.255 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-11T13:35:13.255 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.297 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.049) 0:01:47.052 **** 2019-12-11T13:35:13.302 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-11T13:35:13.304 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.347 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.050) 0:01:47.102 **** 2019-12-11T13:35:13.365 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.405 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.057) 0:01:47.160 **** 2019-12-11T13:35:13.410 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-11T13:35:13.412 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.456 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.045) 0:01:47.205 **** TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.508 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.057) 0:01:47.263 **** 2019-12-11T13:35:13.513 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-11T13:35:13.514 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.553 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.044) 0:01:47.308 **** 2019-12-11T13:35:13.566 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.609 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.056) 0:01:47.364 **** 2019-12-11T13:35:13.614 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-11T13:35:13.615 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:13.616 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:13.654 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.044) 0:01:47.409 **** 2019-12-11T13:35:13.659 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-11T13:35:13.660 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.700 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.045) 0:01:47.455 **** 2019-12-11T13:35:13.709 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-11T13:35:13.711 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.746 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.046) 0:01:47.502 **** 2019-12-11T13:35:13.753 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-11T13:35:13.755 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.793 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.046) 0:01:47.548 **** 2019-12-11T13:35:13.798 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-11T13:35:13.799 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.847 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.054) 0:01:47.602 **** 2019-12-11T13:35:13.854 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-11T13:35:13.855 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:13.856 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:13.894 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.046) 0:01:47.649 **** 2019-12-11T13:35:13.899 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-11T13:35:13.900 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:13.940 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.045) 0:01:47.695 **** 2019-12-11T13:35:13.949 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-11T13:35:13.951 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:13.988 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:13 +0000 (0:00:00.047) 0:01:47.743 **** 2019-12-11T13:35:13.996 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.035 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:47.790 **** 2019-12-11T13:35:14.048 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.082 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.046) 0:01:47.837 **** 2019-12-11T13:35:14.088 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-11T13:35:14.089 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:14.130 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:47.885 **** 2019-12-11T13:35:14.140 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:14.188 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.058) 0:01:47.943 **** 2019-12-11T13:35:14.195 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-11T13:35:14.198 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.235 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:47.991 **** 2019-12-11T13:35:14.241 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-11T13:35:14.243 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.279 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.043) 0:01:48.035 **** 2019-12-11T13:35:14.285 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-11T13:35:14.287 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.332 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.052) 0:01:48.087 **** 2019-12-11T13:35:14.338 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-11T13:35:14.338 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:14.379 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:48.134 **** 2019-12-11T13:35:14.386 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-11T13:35:14.387 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.430 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.051) 0:01:48.185 **** 2019-12-11T13:35:14.438 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-11T13:35:14.440 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.483 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.052) 0:01:48.238 **** 2019-12-11T13:35:14.492 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-11T13:35:14.494 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.534 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.050) 0:01:48.289 **** 2019-12-11T13:35:14.540 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-11T13:35:14.542 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.581 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.046) 0:01:48.336 **** 2019-12-11T13:35:14.587 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-11T13:35:14.588 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:14.629 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:48.383 **** 2019-12-11T13:35:14.635 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-11T13:35:14.636 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.675 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:48.430 **** 2019-12-11T13:35:14.681 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-11T13:35:14.683 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.728 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.049) 0:01:48.480 **** 2019-12-11T13:35:14.731 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-11T13:35:14.733 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.773 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.047) 0:01:48.528 **** 2019-12-11T13:35:14.778 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-11T13:35:14.780 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.822 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.049) 0:01:48.577 **** 2019-12-11T13:35:14.828 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-11T13:35:14.830 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:14.868 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.046) 0:01:48.624 **** 2019-12-11T13:35:14.874 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-11T13:35:14.874 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.913 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.044) 0:01:48.668 **** 2019-12-11T13:35:14.920 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-11T13:35:14.922 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:14.959 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:14 +0000 (0:00:00.045) 0:01:48.714 **** 2019-12-11T13:35:14.964 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-11T13:35:14.966 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.008 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.048) 0:01:48.763 **** 2019-12-11T13:35:15.014 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-11T13:35:15.015 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.052 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.044) 0:01:48.808 **** 2019-12-11T13:35:15.058 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-11T13:35:15.059 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.097 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.044) 0:01:48.852 **** 2019-12-11T13:35:15.103 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-11T13:35:15.105 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.142 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.044) 0:01:48.897 **** 2019-12-11T13:35:15.150 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-11T13:35:15.151 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.187 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.045) 0:01:48.943 **** 2019-12-11T13:35:15.194 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-11T13:35:15.195 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.237 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.049) 0:01:48.992 **** 2019-12-11T13:35:15.242 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-11T13:35:15.243 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:15.286 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.048) 0:01:49.041 **** 2019-12-11T13:35:15.291 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-11T13:35:15.293 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.330 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.044) 0:01:49.085 **** 2019-12-11T13:35:15.335 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-11T13:35:15.375 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.044) 0:01:49.130 **** 2019-12-11T13:35:15.380 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-11T13:35:15.383 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.422 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.047) 0:01:49.178 **** 2019-12-11T13:35:15.428 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-11T13:35:15.429 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.469 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.046) 0:01:49.224 **** 2019-12-11T13:35:15.474 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-11T13:35:15.475 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-11T13:35:15.520 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.051) 0:01:49.275 **** 2019-12-11T13:35:15.546 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-11T13:35:15.583 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.062) 0:01:49.338 **** 2019-12-11T13:35:15.620 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-11T13:35:15.621 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:15.656 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.073) 0:01:49.411 **** 2019-12-11T13:35:15.810 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-11T13:35:15.811 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:35:15.849 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:15 +0000 (0:00:00.192) 0:01:49.604 **** 2019-12-11T13:35:16.014 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:35:16.053 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:16 +0000 (0:00:00.204) 0:01:49.808 **** 2019-12-11T13:35:17.099 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-11T13:35:17.100 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-11T13:35:17.104 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-11T13:35:18.009 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-11T13:35:18.063 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:18 +0000 (0:00:02.010) 0:01:51.819 **** 2019-12-11T13:35:18.073 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-11T13:35:18.132 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:18 +0000 (0:00:00.068) 0:01:51.887 **** 2019-12-11T13:35:19.171 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-11T13:35:19.172 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071318.1-114040425387636/source", "state": "file", "uid": 0} 2019-12-11T13:35:19.173 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071318.17-119706139864195/source", "state": "file", "uid": 0} 2019-12-11T13:35:20.313 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071319.19-86674598351787/source", "state": "file", "uid": 0} 2019-12-11T13:35:20.351 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:20 +0000 (0:00:02.218) 0:01:54.106 **** 2019-12-11T13:35:20.363 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576071319.18-171240264440068/source", "state": "file", "uid": 0} 2019-12-11T13:35:20.414 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:20 +0000 (0:00:00.063) 0:01:54.170 **** 2019-12-11T13:35:20.979 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-11T13:35:21.011 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-11T13:35:21.293 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-11T13:35:21.294 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-11T13:35:21.332 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:21 +0000 (0:00:00.917) 0:01:55.087 **** 2019-12-11T13:35:21.423 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-11T13:35:21.463 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:21 +0000 (0:00:00.130) 0:01:55.218 **** 2019-12-11T13:35:34.275 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-11T13:35:34.277 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.480836", "end": "2019-12-11 13:35:34.245765", "rc": 0, "start": "2019-12-11 13:35:21.764929", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.linux.duke.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.linux.duke.edu", " * extras: mirror.atlanticmetro.net", " * updates: mirror.rackspace.com", "Metadata Cache Created"]} 2019-12-11T13:35:34.317 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:34 +0000 (0:00:12.854) 0:02:08.072 **** 2019-12-11T13:35:34.696 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-11T13:35:34.698 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-11T13:35:34.985 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-11T13:35:35.023 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.705) 0:02:08.778 **** 2019-12-11T13:35:35.049 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-11T13:35:35.051 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.087 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.063) 0:02:08.842 **** 2019-12-11T13:35:35.113 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-11T13:35:35.114 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.149 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.062) 0:02:08.905 **** 2019-12-11T13:35:35.176 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-11T13:35:35.178 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.216 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.063) 0:02:08.968 **** 2019-12-11T13:35:35.240 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-11T13:35:35.242 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.275 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.062) 0:02:09.031 **** 2019-12-11T13:35:35.291 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-11T13:35:35.293 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:13.662109", "end": "2019-12-11 13:35:35.268580", "rc": 0, "start": "2019-12-11 13:35:21.606471", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.linux.duke.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.linux.duke.edu", " * extras: mirror.atlanticmetro.net", " * updates: mirror.rackspace.com", "Metadata Cache Created"]} 2019-12-11T13:35:35.330 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.054) 0:02:09.085 **** 2019-12-11T13:35:35.335 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-11T13:35:35.337 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.374 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.044) 0:02:09.129 **** 2019-12-11T13:35:35.400 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-11T13:35:35.401 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.437 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.061) 0:02:09.191 **** 2019-12-11T13:35:35.472 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-11T13:35:35.473 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.507 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.071) 0:02:09.262 **** 2019-12-11T13:35:35.533 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-11T13:35:35.534 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:35.570 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:35 +0000 (0:00:00.062) 0:02:09.325 **** 2019-12-11T13:35:35.680 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-11T13:35:35.682 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-11T13:35:35.971 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-11T13:35:36.023 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.453) 0:02:09.779 **** 2019-12-11T13:35:36.051 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-11T13:35:36.052 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.092 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.068) 0:02:09.848 **** 2019-12-11T13:35:36.129 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-11T13:35:36.130 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.172 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.079) 0:02:09.927 **** 2019-12-11T13:35:36.197 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-11T13:35:36.199 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.237 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.064) 0:02:09.992 **** 2019-12-11T13:35:36.263 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-11T13:35:36.265 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.311 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.073) 0:02:10.066 **** 2019-12-11T13:35:36.337 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-11T13:35:36.338 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.375 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.064) 0:02:10.130 **** 2019-12-11T13:35:36.401 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-11T13:35:36.403 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.442 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.066) 0:02:10.197 **** 2019-12-11T13:35:36.468 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-11T13:35:36.470 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.515 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.072) 0:02:10.270 **** 2019-12-11T13:35:36.530 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-11T13:35:36.532 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.660491", "end": "2019-12-11 13:35:36.500658", "rc": 0, "start": "2019-12-11 13:35:35.840167", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:35:36.572 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.057) 0:02:10.327 **** 2019-12-11T13:35:36.578 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-11T13:35:36.580 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:36.625 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:36 +0000 (0:00:00.048) 0:02:10.376 **** 2019-12-11T13:35:37.390 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-11T13:35:37.433 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.811) 0:02:11.188 **** 2019-12-11T13:35:37.464 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-11T13:35:37.466 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:37.508 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.074) 0:02:11.263 **** 2019-12-11T13:35:37.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-11T13:35:37.526 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.594881", "end": "2019-12-11 13:35:37.500487", "rc": 0, "start": "2019-12-11 13:35:36.905606", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:35:37.564 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.056) 0:02:11.320 **** 2019-12-11T13:35:37.570 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-11T13:35:37.572 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:37.616 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.051) 0:02:11.371 **** 2019-12-11T13:35:37.654 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-11T13:35:37.656 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:37.693 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.076) 0:02:11.448 **** 2019-12-11T13:35:37.729 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-11T13:35:37.730 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:37.787 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:37 +0000 (0:00:00.094) 0:02:11.543 **** 2019-12-11T13:35:38.085 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-11T13:35:38.086 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-11T13:35:38.233 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.445) 0:02:11.989 **** 2019-12-11T13:35:38.270 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-11T13:35:38.272 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:38.308 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.074) 0:02:12.063 **** 2019-12-11T13:35:38.334 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-11T13:35:38.336 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:38.371 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.063) 0:02:12.127 **** 2019-12-11T13:35:38.398 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-11T13:35:38.399 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:38.436 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.064) 0:02:12.192 **** 2019-12-11T13:35:38.475 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-11T13:35:38.476 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:38.513 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.076) 0:02:12.268 **** 2019-12-11T13:35:38.794 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-11T13:35:38.795 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-11T13:35:38.837 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:38 +0000 (0:00:00.323) 0:02:12.592 **** 2019-12-11T13:35:39.386 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-11T13:35:39.425 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:39 +0000 (0:00:00.588) 0:02:13.181 **** 2019-12-11T13:35:42.799 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-11T13:35:42.800 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-11T13:35:42.844 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:42 +0000 (0:00:03.417) 0:02:16.599 **** 2019-12-11T13:35:43.197 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-11T13:35:43.255 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:43 +0000 (0:00:00.411) 0:02:17.010 **** 2019-12-11T13:35:43.731 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-11T13:35:43.733 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-11T13:35:44.225 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-11T13:35:44.644 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-11T13:35:45.119 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-11T13:35:45.512 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-11T13:35:45.562 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:45 +0000 (0:00:02.307) 0:02:19.317 **** 2019-12-11T13:35:45.869 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-11T13:35:45.870 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:35:45.914 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:45 +0000 (0:00:00.351) 0:02:19.669 **** 2019-12-11T13:35:45.941 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-11T13:35:45.945 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-11T13:35:45.981 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:45 +0000 (0:00:00.067) 0:02:19.737 **** 2019-12-11T13:35:46.307 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-11T13:35:46.308 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:35:46.346 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:46 +0000 (0:00:00.364) 0:02:20.101 **** 2019-12-11T13:35:46.814 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi073.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-11T13:35:47.267 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-11T13:35:47.716 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-11T13:35:48.191 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-11T13:35:48.579 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-11T13:35:48.618 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:48 +0000 (0:00:02.272) 0:02:22.373 **** 2019-12-11T13:35:48.656 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-11T13:35:48.658 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:48.694 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:48 +0000 (0:00:00.076) 0:02:22.450 **** 2019-12-11T13:35:48.743 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-11T13:35:48.745 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-11T13:35:48.782 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:48 +0000 (0:00:00.087) 0:02:22.537 **** 2019-12-11T13:35:49.067 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-11T13:35:49.067 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-11T13:35:49.109 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.326) 0:02:22.864 **** 2019-12-11T13:35:49.118 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-11T13:35:49.163 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.054) 0:02:22.918 **** 2019-12-11T13:35:49.170 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-11T13:35:49.171 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.210 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.046) 0:02:22.965 **** 2019-12-11T13:35:49.226 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-11T13:35:49.227 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.238 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.250 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.261 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-11T13:35:49.262 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-11T13:35:49.264 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.303 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.093) 0:02:23.058 **** 2019-12-11T13:35:49.342 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.039) 0:02:23.098 **** 2019-12-11T13:35:49.686 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-11T13:35:49.688 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-11T13:35:49.727 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.384) 0:02:23.482 **** 2019-12-11T13:35:49.777 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-11T13:35:49.778 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.790 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.801 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.823 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-11T13:35:49.862 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:49 +0000 (0:00:00.135) 0:02:23.618 **** 2019-12-11T13:35:52.672 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-11T13:35:52.672 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-11T13:35:52.716 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:52 +0000 (0:00:02.853) 0:02:26.472 **** 2019-12-11T13:35:52.773 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-11T13:35:52.775 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:52.820 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:52 +0000 (0:00:00.103) 0:02:26.575 **** 2019-12-11T13:35:53.288 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-11T13:35:53.289 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-11T13:35:53.348 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:53 +0000 (0:00:00.528) 0:02:27.103 **** 2019-12-11T13:35:53.388 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-11T13:35:53.390 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:53.427 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:53 +0000 (0:00:00.077) 0:02:27.181 **** 2019-12-11T13:35:53.818 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-11T13:35:53.883 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:53 +0000 (0:00:00.456) 0:02:27.638 **** 2019-12-11T13:35:54.363 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-11T13:35:54.402 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:54 +0000 (0:00:00.518) 0:02:28.157 **** 2019-12-11T13:35:54.802 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-11T13:35:54.803 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-11T13:35:54.850 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:54 +0000 (0:00:00.447) 0:02:28.605 **** 2019-12-11T13:35:54.896 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:54.931 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:54 +0000 (0:00:00.081) 0:02:28.687 **** 2019-12-11T13:35:55.267 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-11T13:35:55.269 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:35:55.325 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.393) 0:02:29.080 **** 2019-12-11T13:35:55.370 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-11T13:35:55.371 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-11T13:35:55.410 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.084) 0:02:29.165 **** 2019-12-11T13:35:55.437 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-11T13:35:55.439 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:55.481 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.071) 0:02:29.236 **** 2019-12-11T13:35:55.694 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-11T13:35:55.696 INFO:teuthology.task.ansible.out:fatal: [smithi073.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-11T13:35:55.763 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.282) 0:02:29.519 **** 2019-12-11T13:35:55.805 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-11T13:35:55.807 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:55.852 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.088) 0:02:29.607 **** 2019-12-11T13:35:55.861 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:35:55.916 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:55 +0000 (0:00:00.063) 0:02:29.671 **** 2019-12-11T13:35:56.778 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-11T13:35:56.779 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-11T13:35:56.840 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:56 +0000 (0:00:00.924) 0:02:30.595 **** 2019-12-11T13:35:56.937 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-11T13:35:56.938 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-11T13:35:56.978 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:56 +0000 (0:00:00.138) 0:02:30.733 **** 2019-12-11T13:35:57.018 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-11T13:35:57.019 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:35:57.076 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:57 +0000 (0:00:00.097) 0:02:30.831 **** 2019-12-11T13:35:57.901 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-11T13:35:57.907 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-12-11 13:33:17 UTC", "ActiveEnterTimestampMonotonic": "19274628", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target time-sync.target systemd-journald.socket var-run.mount nss-lookup.target system.slice basic.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-12-11 13:33:17 UTC", "AssertTimestampMonotonic": "19273932", "Before": "shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-12-11 13:33:17 UTC", "ConditionTimestampMonotonic": "19273930", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8967", "ExecMainStartTimestamp": "Wed 2019-12-11 13:33:17 UTC", "ExecMainStartTimestampMonotonic": "19274572", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-11T13:35:57.908 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Wed 2019-12-11 13:33:17 UTC] ; stop_time=[n/a] ; pid=8967 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-12-11 13:33:17 UTC", "InactiveExitTimestampMonotonic": "19274628", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8967", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-11T13:35:57.910 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-12-11 13:33:17 UTC", "WatchdogTimestampMonotonic": "19274609", "WatchdogUSec": "0"}} 2019-12-11T13:35:57.940 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:57 +0000 (0:00:00.863) 0:02:31.695 **** 2019-12-11T13:35:58.022 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-11T13:35:58.024 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-11T13:35:58.071 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:58 +0000 (0:00:00.130) 0:02:31.826 **** 2019-12-11T13:35:58.259 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-11T13:35:58.261 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004639", "end": "2019-12-11 13:35:58.225404", "rc": 0, "start": "2019-12-11 13:35:58.220765", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-11T13:35:58.304 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:58 +0000 (0:00:00.233) 0:02:32.059 **** 2019-12-11T13:35:58.544 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-11T13:35:58.546 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-12-11 13:33:14 UTC", "ActiveEnterTimestampMonotonic": "19759627", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target basic.target var-run.mount network.target local-fs.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-12-11 13:33:14 UTC", "AssertTimestampMonotonic": "19758650", "Before": "multi-user.target getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-12-11 13:33:14 UTC", "ConditionTimestampMonotonic": "19758649", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8937", "ExecMainStartTimestamp": "Wed 2019-12-11 13:33:14 UTC", "ExecMainStartTimestampMonotonic": "19759529", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-11T13:35:58.547 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Wed 2019-12-11 13:33:14 UTC] ; stop_time=[n/a] ; pid=8937 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-12-11 13:33:14 UTC", "InactiveExitTimestampMonotonic": "19759627", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8937", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-11T13:35:58.549 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-12-11 13:33:14 UTC", "WatchdogTimestampMonotonic": "19759600", "WatchdogUSec": "0"}} 2019-12-11T13:35:58.584 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:58 +0000 (0:00:00.280) 0:02:32.340 **** 2019-12-11T13:35:58.859 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-11T13:35:58.934 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:58 +0000 (0:00:00.349) 0:02:32.689 **** 2019-12-11T13:35:58.942 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-11T13:35:58.943 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004492", "end": "2019-12-11 13:35:58.878877", "rc": 0, "start": "2019-12-11 13:35:58.874385", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-11T13:35:58.986 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:58 +0000 (0:00:00.051) 0:02:32.741 **** 2019-12-11T13:35:59.490 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-11T13:35:59.491 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-11T13:35:59.562 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:35:59 +0000 (0:00:00.576) 0:02:33.318 **** 2019-12-11T13:36:25.519 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-11T13:36:25.520 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-11T13:36:25.522 INFO:teuthology.task.ansible.out: 20 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-11T13:36:25.565 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:25 +0000 (0:00:26.002) 0:02:59.321 **** 2019-12-11T13:36:25.677 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-11T13:36:25.679 INFO:teuthology.task.ansible.out: 20 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-11T13:36:25.755 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:25 +0000 (0:00:00.189) 0:02:59.511 **** 2019-12-11T13:36:26.223 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-11T13:36:26.258 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:26 +0000 (0:00:00.501) 0:03:00.012 **** 2019-12-11T13:36:26.285 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-11T13:36:26.330 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:26 +0000 (0:00:00.073) 0:03:00.086 **** 2019-12-11T13:36:34.283 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-11T13:36:34.285 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.717902", "end": "2019-12-11 13:36:34.249193", "failed_when_result": false, "rc": 0, "start": "2019-12-11 13:36:26.531291", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-11T13:36:34.341 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:34 +0000 (0:00:08.010) 0:03:08.096 **** 2019-12-11T13:36:34.472 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.820846", "end": "2019-12-11 13:36:34.444145", "failed_when_result": false, "rc": 0, "start": "2019-12-11 13:36:26.623299", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-11T13:36:34.524 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:34 +0000 (0:00:00.181) 0:03:08.279 **** 2019-12-11T13:36:35.258 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-11T13:36:35.260 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-11T13:36:35.304 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:35 +0000 (0:00:00.779) 0:03:09.059 **** 2019-12-11T13:36:35.492 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-11T13:36:35.539 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:35 +0000 (0:00:00.234) 0:03:09.293 **** 2019-12-11T13:36:35.648 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-11T13:36:35.649 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022426", "end": "2019-12-11 13:36:35.626072", "rc": 0, "start": "2019-12-11 13:36:35.603646", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-11T13:36:35.687 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:35 +0000 (0:00:00.149) 0:03:09.443 **** 2019-12-11T13:36:35.885 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012775", "end": "2019-12-11 13:36:35.856717", "rc": 0, "start": "2019-12-11 13:36:35.843942", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-11T13:36:35.919 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:35 +0000 (0:00:00.232) 0:03:09.675 **** 2019-12-11T13:36:36.031 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-11T13:36:36.031 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.018450", "end": "2019-12-11 13:36:36.001441", "rc": 0, "start": "2019-12-11 13:36:35.982991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:36.070 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:36 +0000 (0:00:00.150) 0:03:09.825 **** 2019-12-11T13:36:36.277 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.031736", "end": "2019-12-11 13:36:36.238930", "rc": 0, "start": "2019-12-11 13:36:36.207194", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:36.344 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:36 +0000 (0:00:00.272) 0:03:10.098 **** 2019-12-11T13:36:44.070 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-11T13:36:44.072 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.696127", "end": "2019-12-11 13:36:44.037287", "rc": 0, "start": "2019-12-11 13:36:36.341160", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:44.132 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:07.789) 0:03:17.887 **** 2019-12-11T13:36:44.419 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.751218", "end": "2019-12-11 13:36:44.388398", "rc": 0, "start": "2019-12-11 13:36:36.637180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:44.459 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.327) 0:03:18.214 **** 2019-12-11T13:36:44.475 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-11T13:36:44.476 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-11T13:36:44.527 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.068) 0:03:18.282 **** 2019-12-11T13:36:44.586 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-11T13:36:44.587 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-11T13:36:44.631 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.103) 0:03:18.386 **** 2019-12-11T13:36:44.669 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-11T13:36:44.724 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.091) 0:03:18.477 **** 2019-12-11T13:36:44.761 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-11T13:36:44.763 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-11T13:36:44.827 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.101) 0:03:18.579 **** 2019-12-11T13:36:44.836 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-11T13:36:44.882 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.058) 0:03:18.637 **** 2019-12-11T13:36:44.888 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-11T13:36:44.889 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-11T13:36:44.932 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.049) 0:03:18.687 **** 2019-12-11T13:36:44.938 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-11T13:36:44.939 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-11T13:36:44.988 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:44 +0000 (0:00:00.056) 0:03:18.743 **** 2019-12-11T13:36:45.036 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-11T13:36:45.038 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-11T13:36:45.079 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.091) 0:03:18.834 **** 2019-12-11T13:36:45.139 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-11T13:36:45.140 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-11T13:36:45.177 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.098) 0:03:18.933 **** 2019-12-11T13:36:45.214 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-11T13:36:45.219 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-11T13:36:45.274 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.096) 0:03:19.030 **** 2019-12-11T13:36:45.281 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-11T13:36:45.282 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-11T13:36:45.330 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.047) 0:03:19.077 **** 2019-12-11T13:36:45.622 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-11T13:36:45.680 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.347) 0:03:19.425 **** 2019-12-11T13:36:45.685 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-11T13:36:45.686 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-11T13:36:45.723 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.053) 0:03:19.479 **** 2019-12-11T13:36:45.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-11T13:36:45.751 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:36:45.791 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.066) 0:03:19.546 **** 2019-12-11T13:36:45.830 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-11T13:36:45.833 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:36:45.872 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:45 +0000 (0:00:00.081) 0:03:19.627 **** 2019-12-11T13:36:45.984 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-11T13:36:46.022 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:46 +0000 (0:00:00.150) 0:03:19.777 **** 2019-12-11T13:36:46.070 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-11T13:36:46.072 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:36:46.120 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:46 +0000 (0:00:00.098) 0:03:19.875 **** 2019-12-11T13:36:46.168 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:36:46.205 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:46 +0000 (0:00:00.084) 0:03:19.960 **** 2019-12-11T13:36:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-11T13:36:46.244 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-11T13:36:46.280 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:46 +0000 (0:00:00.075) 0:03:20.036 **** 2019-12-11T13:36:46.556 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-11T13:36:46.615 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:46 +0000 (0:00:00.334) 0:03:20.370 **** 2019-12-11T13:36:47.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-11T13:36:47.306 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-11T13:36:47.360 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:47 +0000 (0:00:00.745) 0:03:21.115 **** 2019-12-11T13:36:47.362 INFO:teuthology.task.ansible.out: 2019-12-11T13:36:47.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-11T13:36:47.406 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi073"}, "changed": false} 2019-12-11T13:36:47.442 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:47 +0000 (0:00:00.082) 0:03:21.197 **** 2019-12-11T13:36:47.682 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-11T13:36:47.682 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-11T13:36:47.729 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:47 +0000 (0:00:00.287) 0:03:21.485 **** 2019-12-11T13:36:47.767 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-11T13:36:47.769 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi150"}, "changed": false} 2019-12-11T13:36:47.828 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:47 +0000 (0:00:00.097) 0:03:21.583 **** 2019-12-11T13:36:48.450 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi073.front.sepia.ceph.com", "ansible_hostname": "smithi073", "ansible_nodename": "smithi073"}, "changed": true, "name": "smithi073"} 2019-12-11T13:36:48.514 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:48 +0000 (0:00:00.686) 0:03:22.269 **** 2019-12-11T13:36:48.520 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi150.front.sepia.ceph.com", "ansible_hostname": "smithi150", "ansible_nodename": "smithi150"}, "changed": true, "name": "smithi150"} 2019-12-11T13:36:48.559 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:48 +0000 (0:00:00.045) 0:03:22.314 **** 2019-12-11T13:36:49.475 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-11T13:36:49.529 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:49 +0000 (0:00:00.969) 0:03:23.284 **** 2019-12-11T13:36:49.537 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-11T13:36:49.580 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:49 +0000 (0:00:00.051) 0:03:23.336 **** 2019-12-11T13:36:50.436 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-11T13:36:50.438 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-11T13:36:50.489 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:50 +0000 (0:00:00.908) 0:03:24.245 **** 2019-12-11T13:36:50.550 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-11T13:36:50.590 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:50 +0000 (0:00:00.100) 0:03:24.345 **** 2019-12-11T13:36:51.450 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-11T13:36:51.452 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-11T13:36:51.507 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:51 +0000 (0:00:00.916) 0:03:25.261 **** 2019-12-11T13:36:51.516 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-11T13:36:51.557 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:51 +0000 (0:00:00.051) 0:03:25.312 **** 2019-12-11T13:36:52.492 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-11T13:36:52.530 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:52 +0000 (0:00:00.972) 0:03:26.285 **** 2019-12-11T13:36:52.537 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-11T13:36:52.580 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:52 +0000 (0:00:00.046) 0:03:26.331 **** 2019-12-11T13:36:52.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-11T13:36:52.851 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-11T13:36:52.890 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:52 +0000 (0:00:00.313) 0:03:26.645 **** 2019-12-11T13:36:52.907 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-11T13:36:52.953 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:52 +0000 (0:00:00.063) 0:03:26.709 **** 2019-12-11T13:36:53.230 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-11T13:36:53.232 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-11T13:36:53.273 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:53 +0000 (0:00:00.319) 0:03:27.028 **** 2019-12-11T13:36:53.290 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-11T13:36:53.333 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:53 +0000 (0:00:00.059) 0:03:27.088 **** 2019-12-11T13:36:53.625 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-11T13:36:53.626 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-11T13:36:53.663 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:53 +0000 (0:00:00.330) 0:03:27.418 **** 2019-12-11T13:36:53.683 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-11T13:36:53.722 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:53 +0000 (0:00:00.059) 0:03:27.478 **** 2019-12-11T13:36:54.636 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-11T13:36:54.687 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:54 +0000 (0:00:00.964) 0:03:28.442 **** 2019-12-11T13:36:54.695 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-11T13:36:54.736 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:54 +0000 (0:00:00.049) 0:03:28.492 **** 2019-12-11T13:36:55.640 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-11T13:36:55.677 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:55 +0000 (0:00:00.940) 0:03:29.432 **** 2019-12-11T13:36:55.693 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-11T13:36:55.732 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:55 +0000 (0:00:00.054) 0:03:29.487 **** 2019-12-11T13:36:58.098 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-11T13:36:58.100 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.043974", "end": "2019-12-11 13:36:58.062965", "rc": 0, "start": "2019-12-11 13:36:56.018991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:58.138 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:58 +0000 (0:00:02.406) 0:03:31.894 **** 2019-12-11T13:36:58.176 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-11T13:36:58.221 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:58 +0000 (0:00:00.082) 0:03:31.976 **** 2019-12-11T13:36:58.229 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-11T13:36:58.230 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.162259", "end": "2019-12-11 13:36:58.156215", "rc": 0, "start": "2019-12-11 13:36:55.993956", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:36:58.272 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:58 +0000 (0:00:00.049) 0:03:32.026 **** 2019-12-11T13:36:58.308 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-11T13:36:58.347 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:36:58 +0000 (0:00:00.075) 0:03:32.102 **** 2019-12-11T13:36:59.212 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-11T13:36:59.213 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-11T13:36:59.281 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-11T13:37:00.175 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-11T13:37:00.215 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:01.867) 0:03:33.970 **** 2019-12-11T13:37:00.258 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.292 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.076) 0:03:34.047 **** 2019-12-11T13:37:00.299 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-11T13:37:00.300 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-11T13:37:00.347 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.055) 0:03:34.102 **** 2019-12-11T13:37:00.357 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.397 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.049) 0:03:34.152 **** 2019-12-11T13:37:00.404 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-11T13:37:00.406 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.462 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.064) 0:03:34.217 **** 2019-12-11T13:37:00.469 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.527 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.065) 0:03:34.283 **** 2019-12-11T13:37:00.534 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-11T13:37:00.540 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.575 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.047) 0:03:34.331 **** 2019-12-11T13:37:00.584 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-11T13:37:00.620 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.045) 0:03:34.376 **** 2019-12-11T13:37:00.626 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-11T13:37:00.640 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:00.667 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.046) 0:03:34.422 **** 2019-12-11T13:37:00.714 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-11T13:37:00.755 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:00 +0000 (0:00:00.087) 0:03:34.510 **** 2019-12-11T13:37:01.141 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-11T13:37:01.143 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-11T13:37:01.189 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:01 +0000 (0:00:00.433) 0:03:34.944 **** 2019-12-11T13:37:01.238 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-11T13:37:01.306 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:01 +0000 (0:00:00.115) 0:03:35.060 **** 2019-12-11T13:37:01.879 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-11T13:37:01.880 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.327123", "end": "2019-12-11 13:37:01.839678", "rc": 0, "start": "2019-12-11 13:37:01.512555", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.linux.duke.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.atlanticmetro.net", " * updates: mirror.rackspace.com", "No unfinished transactions left."]} 2019-12-11T13:37:01.931 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:01 +0000 (0:00:00.625) 0:03:35.686 **** 2019-12-11T13:37:01.979 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.328836", "end": "2019-12-11 13:37:01.938173", "rc": 0, "start": "2019-12-11 13:37:01.609337", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.linux.duke.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.atlanticmetro.net", " * updates: mirror.rackspace.com", "No unfinished transactions left."]} 2019-12-11T13:37:02.022 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:02 +0000 (0:00:00.091) 0:03:35.777 **** 2019-12-11T13:37:02.329 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-11T13:37:02.330 INFO:teuthology.task.ansible.out:fatal: [smithi073.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.056579", "end": "2019-12-11 13:37:02.300445", "msg": "non-zero return code", "rc": 1, "start": "2019-12-11 13:37:02.243866", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-11T13:37:02.391 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:02 +0000 (0:00:00.368) 0:03:36.146 **** 2019-12-11T13:37:02.411 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.056387", "end": "2019-12-11 13:37:02.372799", "msg": "non-zero return code", "rc": 1, "start": "2019-12-11 13:37:02.316412", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-11T13:37:02.454 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:02 +0000 (0:00:00.063) 0:03:36.210 **** 2019-12-11T13:37:02.463 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:02.520 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:02 +0000 (0:00:00.063) 0:03:36.273 **** 2019-12-11T13:37:02.526 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:02.570 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:02 +0000 (0:00:00.052) 0:03:36.325 **** 2019-12-11T13:37:10.896 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 2019-12-11T13:37:10.897 INFO:teuthology.task.ansible.out: @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemov 2019-12-11T13:37:10.899 INFO:teuthology.task.ansible.out:ed:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-11T13:37:10.948 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:10 +0000 (0:00:08.378) 0:03:44.703 **** 2019-12-11T13:37:11.195 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-11T13:37:11.196 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-11T13:37:11.200 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-11T13:37:11.249 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:11 +0000 (0:00:00.300) 0:03:45.004 **** 2019-12-11T13:37:14.459 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-11T13:37:14.460 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-11T13:37:14.517 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:14 +0000 (0:00:03.268) 0:03:48.273 **** 2019-12-11T13:37:14.648 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-11T13:37:14.696 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:14 +0000 (0:00:00.177) 0:03:48.451 **** 2019-12-11T13:37:32.945 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-11T13:37:32.947 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-11T13:37:32.948 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-11T13:37:32.950 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies 2019-12-11T13:37:32.952 INFO:teuthology.task.ansible.out:Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 24 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-11T13:37:32.953 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.e 2019-12-11T13:37:32.955 INFO:teuthology.task.ansible.out:l7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-11T13:37:32.991 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:32 +0000 (0:00:18.295) 0:04:06.746 **** 2019-12-11T13:37:33.002 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-11T13:37:33.004 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-11T13:37:33.006 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.linux.duke.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: mirror.rackspace.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies 2019-12-11T13:37:33.007 INFO:teuthology.task.ansible.out:Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 22 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-11T13:37:33.009 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-11T13:37:33.061 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:33 +0000 (0:00:00.069) 0:04:06.816 **** 2019-12-11T13:37:33.792 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-11T13:37:33.793 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-11T13:37:33.831 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:33 +0000 (0:00:00.769) 0:04:07.586 **** 2019-12-11T13:37:33.848 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-11T13:37:33.887 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:33 +0000 (0:00:00.056) 0:04:07.642 **** 2019-12-11T13:37:34.361 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-11T13:37:34.361 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-11T13:37:34.407 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:34 +0000 (0:00:00.520) 0:04:08.162 **** 2019-12-11T13:37:34.414 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-11T13:37:34.476 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:34 +0000 (0:00:00.068) 0:04:08.231 **** 2019-12-11T13:37:34.483 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-11T13:37:34.484 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:34.529 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:34 +0000 (0:00:00.052) 0:04:08.284 **** 2019-12-11T13:37:34.534 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:34.576 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:34 +0000 (0:00:00.046) 0:04:08.331 **** 2019-12-11T13:37:34.981 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-11T13:37:34.983 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ipset.service ip6tables.service shutdown.target ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-11T13:37:34.984 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-11T13:37:34.986 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-11T13:37:34.991 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service polkit.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ip6tables.service ebtables.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-11T13:37:34.992 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-11T13:37:34.994 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-11T13:37:35.038 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:35 +0000 (0:00:00.462) 0:04:08.793 **** 2019-12-11T13:37:35.086 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:35 +0000 (0:00:00.048) 0:04:08.841 **** 2019-12-11T13:37:35.422 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-11T13:37:35.424 INFO:teuthology.task.ansible.out:fatal: [smithi073.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-11T13:37:35.467 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:35 +0000 (0:00:00.380) 0:04:09.222 **** 2019-12-11T13:37:35.494 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-11T13:37:35.537 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:35 +0000 (0:00:00.069) 0:04:09.292 **** 2019-12-11T13:37:36.296 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-11T13:37:36.345 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.808) 0:04:10.100 **** 2019-12-11T13:37:36.351 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-11T13:37:36.390 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.045) 0:04:10.145 **** 2019-12-11T13:37:36.396 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-11T13:37:36.404 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.436 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.045) 0:04:10.191 **** 2019-12-11T13:37:36.441 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.483 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.047) 0:04:10.239 **** 2019-12-11T13:37:36.492 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-11T13:37:36.542 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.058) 0:04:10.297 **** 2019-12-11T13:37:36.587 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.045) 0:04:10.343 **** 2019-12-11T13:37:36.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.634 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.046) 0:04:10.389 **** 2019-12-11T13:37:36.641 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.681 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.046) 0:04:10.436 **** 2019-12-11T13:37:36.687 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-11T13:37:36.688 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.730 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.048) 0:04:10.485 **** 2019-12-11T13:37:36.736 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.782 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.052) 0:04:10.537 **** 2019-12-11T13:37:36.789 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-11T13:37:36.791 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.793 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.837 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.054) 0:04:10.592 **** 2019-12-11T13:37:36.843 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.844 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.881 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.044) 0:04:10.637 **** 2019-12-11T13:37:36.888 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-11T13:37:36.889 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.933 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.051) 0:04:10.688 **** 2019-12-11T13:37:36.947 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:36.985 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:36 +0000 (0:00:00.051) 0:04:10.740 **** 2019-12-11T13:37:36.992 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-11T13:37:37.032 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:10.787 **** 2019-12-11T13:37:37.079 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:10.834 **** 2019-12-11T13:37:37.087 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-11T13:37:37.088 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.127 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.048) 0:04:10.882 **** 2019-12-11T13:37:37.135 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.173 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.046) 0:04:10.929 **** 2019-12-11T13:37:37.184 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.223 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.049) 0:04:10.978 **** 2019-12-11T13:37:37.229 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.269 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.045) 0:04:11.024 **** 2019-12-11T13:37:37.275 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-11T13:37:37.276 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.316 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:11.072 **** 2019-12-11T13:37:37.323 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.364 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:11.119 **** 2019-12-11T13:37:37.370 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-11T13:37:37.372 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.411 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:11.166 **** 2019-12-11T13:37:37.424 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.461 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.049) 0:04:11.216 **** 2019-12-11T13:37:37.467 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-11T13:37:37.469 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.509 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.047) 0:04:11.264 **** 2019-12-11T13:37:37.514 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.555 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.046) 0:04:11.311 **** 2019-12-11T13:37:37.561 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-11T13:37:37.563 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.605 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.049) 0:04:11.360 **** 2019-12-11T13:37:37.620 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.652 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.046) 0:04:11.407 **** 2019-12-11T13:37:37.660 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-11T13:37:37.661 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.696 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.044) 0:04:11.452 **** 2019-12-11T13:37:37.703 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.746 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.049) 0:04:11.502 **** 2019-12-11T13:37:37.752 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-11T13:37:37.754 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.791 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.044) 0:04:11.546 **** 2019-12-11T13:37:37.798 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.838 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.046) 0:04:11.593 **** 2019-12-11T13:37:37.844 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-11T13:37:37.845 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.884 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.046) 0:04:11.640 **** 2019-12-11T13:37:37.893 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.937 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.052) 0:04:11.693 **** 2019-12-11T13:37:37.944 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-11T13:37:37.945 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:37.988 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:37 +0000 (0:00:00.050) 0:04:11.743 **** 2019-12-11T13:37:37.995 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.043 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.054) 0:04:11.798 **** 2019-12-11T13:37:38.050 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-11T13:37:38.050 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.096 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.052) 0:04:11.851 **** 2019-12-11T13:37:38.102 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.140 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.044) 0:04:11.895 **** 2019-12-11T13:37:38.148 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-11T13:37:38.150 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.187 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.046) 0:04:11.942 **** 2019-12-11T13:37:38.193 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.231 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.044) 0:04:11.986 **** 2019-12-11T13:37:38.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-11T13:37:38.238 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.276 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.031 **** 2019-12-11T13:37:38.283 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.322 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.077 **** 2019-12-11T13:37:38.328 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-11T13:37:38.330 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.366 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.044) 0:04:12.122 **** 2019-12-11T13:37:38.381 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.424 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.052) 0:04:12.174 **** 2019-12-11T13:37:38.425 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-11T13:37:38.427 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.464 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.219 **** 2019-12-11T13:37:38.470 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.510 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.265 **** 2019-12-11T13:37:38.516 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-11T13:37:38.518 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.556 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.311 **** 2019-12-11T13:37:38.562 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.606 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.049) 0:04:12.361 **** 2019-12-11T13:37:38.617 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-11T13:37:38.619 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.655 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.048) 0:04:12.410 **** 2019-12-11T13:37:38.661 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.700 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.456 **** 2019-12-11T13:37:38.707 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-11T13:37:38.708 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.749 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.048) 0:04:12.504 **** 2019-12-11T13:37:38.755 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.794 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.045) 0:04:12.549 **** 2019-12-11T13:37:38.800 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-11T13:37:38.801 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.841 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.046) 0:04:12.596 **** 2019-12-11T13:37:38.849 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.900 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.058) 0:04:12.655 **** 2019-12-11T13:37:38.906 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-11T13:37:38.908 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:38.954 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:38 +0000 (0:00:00.054) 0:04:12.709 **** 2019-12-11T13:37:38.960 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.005 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.050) 0:04:12.760 **** 2019-12-11T13:37:39.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-11T13:37:39.013 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.074 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.069) 0:04:12.829 **** 2019-12-11T13:37:39.080 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.122 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.048) 0:04:12.878 **** 2019-12-11T13:37:39.130 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-11T13:37:39.132 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.175 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.052) 0:04:12.930 **** 2019-12-11T13:37:39.182 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.229 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.053) 0:04:12.984 **** 2019-12-11T13:37:39.238 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-11T13:37:39.240 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.279 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.050) 0:04:13.035 **** 2019-12-11T13:37:39.285 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.324 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.044) 0:04:13.079 **** 2019-12-11T13:37:39.330 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-11T13:37:39.332 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.377 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.052) 0:04:13.132 **** 2019-12-11T13:37:39.384 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.425 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.048) 0:04:13.181 **** 2019-12-11T13:37:39.433 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-11T13:37:39.434 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.474 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.048) 0:04:13.229 **** 2019-12-11T13:37:39.482 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.519 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.045) 0:04:13.275 **** 2019-12-11T13:37:39.528 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.580 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.057) 0:04:13.332 **** 2019-12-11T13:37:39.584 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:39.631 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.054) 0:04:13.386 **** 2019-12-11T13:37:39.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-11T13:37:39.939 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.307) 0:04:13.694 **** 2019-12-11T13:37:39.956 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-11T13:37:39.995 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:39 +0000 (0:00:00.055) 0:04:13.750 **** 2019-12-11T13:37:40.290 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-11T13:37:40.293 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:37:40.330 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.335) 0:04:14.085 **** 2019-12-11T13:37:40.369 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:37:40.410 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.079) 0:04:14.165 **** 2019-12-11T13:37:40.644 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-11T13:37:40.646 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-11T13:37:40.685 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.275) 0:04:14.441 **** 2019-12-11T13:37:40.724 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-11T13:37:40.725 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:40.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-11T13:37:40.728 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-11T13:37:40.788 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.102) 0:04:14.543 **** 2019-12-11T13:37:40.828 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.039) 0:04:14.583 **** 2019-12-11T13:37:40.834 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-11T13:37:40.835 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:40.879 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.051) 0:04:14.635 **** 2019-12-11T13:37:40.898 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:40.939 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.059) 0:04:14.695 **** 2019-12-11T13:37:40.948 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:40.987 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:40 +0000 (0:00:00.047) 0:04:14.742 **** 2019-12-11T13:37:40.994 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-11T13:37:40.995 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.042 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.055) 0:04:14.797 **** 2019-12-11T13:37:41.048 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.089 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.046) 0:04:14.844 **** 2019-12-11T13:37:41.096 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-11T13:37:41.098 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.141 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.052) 0:04:14.896 **** 2019-12-11T13:37:41.147 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.186 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.044) 0:04:14.941 **** 2019-12-11T13:37:41.194 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-11T13:37:41.196 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.233 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.047) 0:04:14.988 **** 2019-12-11T13:37:41.239 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.296 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.062) 0:04:15.051 **** 2019-12-11T13:37:41.303 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-11T13:37:41.305 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.345 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.048) 0:04:15.100 **** 2019-12-11T13:37:41.351 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.397 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.051) 0:04:15.152 **** 2019-12-11T13:37:41.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-11T13:37:41.406 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.464 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.062) 0:04:15.214 **** 2019-12-11T13:37:41.468 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.513 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.053) 0:04:15.268 **** 2019-12-11T13:37:41.521 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-11T13:37:41.522 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.561 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.048) 0:04:15.316 **** 2019-12-11T13:37:41.568 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.617 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.054) 0:04:15.371 **** 2019-12-11T13:37:41.623 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-11T13:37:41.624 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.664 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.047) 0:04:15.419 **** 2019-12-11T13:37:41.669 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.721 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.056) 0:04:15.475 **** 2019-12-11T13:37:41.732 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-11T13:37:41.733 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.774 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.053) 0:04:15.529 **** 2019-12-11T13:37:41.780 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.819 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.045) 0:04:15.575 **** 2019-12-11T13:37:41.826 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-11T13:37:41.827 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.875 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.055) 0:04:15.630 **** 2019-12-11T13:37:41.883 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.923 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.048) 0:04:15.679 **** 2019-12-11T13:37:41.930 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-11T13:37:41.931 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:41.971 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:41 +0000 (0:00:00.048) 0:04:15.727 **** 2019-12-11T13:37:41.980 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.020 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.048) 0:04:15.775 **** 2019-12-11T13:37:42.026 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-11T13:37:42.028 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.065 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.044) 0:04:15.820 **** 2019-12-11T13:37:42.074 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.111 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.045) 0:04:15.866 **** 2019-12-11T13:37:42.118 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-11T13:37:42.119 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.157 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.045) 0:04:15.911 **** 2019-12-11T13:37:42.163 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.219 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.063) 0:04:15.975 **** 2019-12-11T13:37:42.228 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-11T13:37:42.229 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.272 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.052) 0:04:16.027 **** 2019-12-11T13:37:42.278 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.325 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.052) 0:04:16.080 **** 2019-12-11T13:37:42.337 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-11T13:37:42.338 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.379 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.053) 0:04:16.134 **** 2019-12-11T13:37:42.386 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.439 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.060) 0:04:16.194 **** 2019-12-11T13:37:42.446 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-11T13:37:42.448 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.489 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.049) 0:04:16.244 **** 2019-12-11T13:37:42.497 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.544 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.055) 0:04:16.299 **** 2019-12-11T13:37:42.551 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-11T13:37:42.552 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.590 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.045) 0:04:16.345 **** 2019-12-11T13:37:42.598 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.638 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.048) 0:04:16.393 **** 2019-12-11T13:37:42.645 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.685 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.046) 0:04:16.440 **** 2019-12-11T13:37:42.691 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.738 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.053) 0:04:16.493 **** 2019-12-11T13:37:42.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-11T13:37:42.746 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.784 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.045) 0:04:16.539 **** 2019-12-11T13:37:42.790 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.844 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.055) 0:04:16.595 **** 2019-12-11T13:37:42.849 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-11T13:37:42.849 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.887 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.047) 0:04:16.642 **** 2019-12-11T13:37:42.894 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.935 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.047) 0:04:16.690 **** 2019-12-11T13:37:42.942 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-11T13:37:42.943 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:42.984 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:42 +0000 (0:00:00.047) 0:04:16.737 **** 2019-12-11T13:37:42.989 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.030 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.048) 0:04:16.786 **** 2019-12-11T13:37:43.036 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-11T13:37:43.038 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-11T13:37:43.079 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.048) 0:04:16.834 **** 2019-12-11T13:37:43.088 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-11T13:37:43.130 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.051) 0:04:16.885 **** 2019-12-11T13:37:43.137 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-11T13:37:43.139 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.140 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-11T13:37:43.151 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.163 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.174 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.175 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.191 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-11T13:37:43.194 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.262 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.131) 0:04:17.017 **** 2019-12-11T13:37:43.268 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.269 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.270 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.278 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.320 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.058) 0:04:17.076 **** 2019-12-11T13:37:43.424 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-11T13:37:43.424 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004152", "end": "2019-12-11 13:37:43.388861", "rc": 0, "start": "2019-12-11 13:37:43.384709", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-11T13:37:43.477 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.149) 0:04:17.226 **** 2019-12-11T13:37:43.489 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004518", "end": "2019-12-11 13:37:43.459786", "rc": 0, "start": "2019-12-11 13:37:43.455268", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-11T13:37:43.535 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.064) 0:04:17.290 **** 2019-12-11T13:37:43.545 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-11T13:37:43.546 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.593 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.058) 0:04:17.349 **** 2019-12-11T13:37:43.600 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.652 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.058) 0:04:17.407 **** 2019-12-11T13:37:43.660 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-11T13:37:43.662 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.702 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.049) 0:04:17.457 **** 2019-12-11T13:37:43.709 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.753 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.050) 0:04:17.508 **** 2019-12-11T13:37:43.764 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.812 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.059) 0:04:17.567 **** 2019-12-11T13:37:43.830 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.870 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.058) 0:04:17.625 **** 2019-12-11T13:37:43.876 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-11T13:37:43.877 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.916 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.044) 0:04:17.670 **** 2019-12-11T13:37:43.920 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:43.962 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:43 +0000 (0:00:00.047) 0:04:17.717 **** 2019-12-11T13:37:44.374 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-11T13:37:44.375 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-11T13:37:44.423 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.457) 0:04:18.174 **** 2019-12-11T13:37:44.426 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-11T13:37:44.473 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.053) 0:04:18.228 **** 2019-12-11T13:37:44.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-11T13:37:44.481 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={u'block_used': 13037553, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286931, u'size_available': 930967269376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286931, "block_size": 4096, "block_total": 240324484, "block_used": 13037553, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967269376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-11T13:37:44.528 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.055) 0:04:18.284 **** 2019-12-11T13:37:44.535 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={u'block_used': 13037660, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286824, u'size_available': 930966831104, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286824, "block_size": 4096, "block_total": 240324484, "block_used": 13037660, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966831104, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-11T13:37:44.581 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.050) 0:04:18.334 **** 2019-12-11T13:37:44.822 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009902", "end": "2019-12-11 13:37:44.797799", "rc": 0, "start": "2019-12-11 13:37:44.787897", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:44.880 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.300) 0:04:18.635 **** 2019-12-11T13:37:44.920 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-11T13:37:44.921 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'block_used': 13037553, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286931, u'size_available': 930967269376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286931, "block_size": 4096, "block_total": 240324484, "block_used": 13037553, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967269376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:44.982 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:44 +0000 (0:00:00.102) 0:04:18.737 **** 2019-12-11T13:37:44.989 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-11T13:37:44.991 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014163", "end": "2019-12-11 13:37:44.911126", "rc": 0, "start": "2019-12-11 13:37:44.896963", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:45.031 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:45 +0000 (0:00:00.048) 0:04:18.786 **** 2019-12-11T13:37:45.038 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-11T13:37:45.078 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:45 +0000 (0:00:00.046) 0:04:18.833 **** 2019-12-11T13:37:45.083 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-11T13:37:45.085 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'block_used': 13037660, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286824, u'size_available': 930966831104, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286824, "block_size": 4096, "block_total": 240324484, "block_used": 13037660, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966831104, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:45.136 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:45 +0000 (0:00:00.057) 0:04:18.891 **** 2019-12-11T13:37:45.144 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-11T13:37:45.145 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTME', u'wwn-0x5000c5009293e56f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XTME', u'wwn': u'0x5000c5009293e56f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', u'wwn-0x5000c5009293e56f-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-11T13:37:45.147 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:45.160 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-11T13:37:45.197 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:45 +0000 (0:00:00.060) 0:04:18.952 **** 2019-12-11T13:37:45.247 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-11T13:37:45.248 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QAQQ', u'wwn-0x5000c50091e0ab90'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QAQQ', u'wwn': u'0x5000c50091e0ab90', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1', u'wwn-0x5000c50091e0ab90-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ", "wwn-0x5000c50091e0ab90"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1", "wwn-0x5000c50091e0ab90-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAQQ", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-11T13:37:45.250 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e0ab90"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:46.862 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-yJmbs3-l4fT-DEuU-RMxH-CqVc-9eFr-8Fge1t', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', u'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.446843", "end": "2019-12-11 13:37:46.824833", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-yJmbs3-l4fT-DEuU-RMxH-CqVc-9eFr-8Fge1t", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:45.377 2019-12-11T13:37:46.864 INFO:teuthology.task.ansible.out:990", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:47.149 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-E3XEef-iq3L-5moX-JiRO-1gs7-gmqb-FoaFKN', u'nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN', u'nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.582019", "end": "2019-12-11 13:37:47.099908", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-E3XEef-iq3L-5moX-JiRO-1gs7-gmqb-FoaFKN", "nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN", "nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:45.517 2019-12-11T13:37:47.151 INFO:teuthology.task.ansible.out:889", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:48.252 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfgPdtKM8WgUWasO7slfWxNrNU6N0dUYXq'], u'uuids': [u'f36daead-068e-473b-9c74-9cccf89d66dd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.058733", "end": "2019-12-11 13:37:48.211150", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfgPdtKM8WgUWasO7slfWxNrNU6N0dUYXq"], "labels": [], "masters": [], "uuids": ["f36daead-068e-473b-9c74-9cccf89d66dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:47.152417", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:48.532 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGSNGbSXL0iWb2DmUCQK6tlQJc2U3n1Qy9'], u'uuids': [u'0928b6b3-ad80-42fa-9a93-a3073ddb5d8a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.063519", "end": "2019-12-11 13:37:48.474271", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGSNGbSXL0iWb2DmUCQK6tlQJc2U3n1Qy9"], "labels": [], "masters": [], "uuids": ["0928b6b3-ad80-42fa-9a93-a3073ddb5d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:47.410752", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:49.643 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfsqS6rWQNJhm6yd9RmsLYvGFCnT26mC9X'], u'uuids': [u'5fcd4ab1-278d-4798-813b-78dbd62fdbd2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066014", "end": "2019-12-11 13:37:49.609133", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfsqS6rWQNJhm6yd9RmsLYvGFCnT26mC9X"], "labels": [], "masters": [], "uuids": ["5fcd4ab1-278d-4798-813b-78dbd62fdbd2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:48.543119", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:49.918 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGZ0oGuSmFjAMZ8B78ARok21wY8YaRNd1s'], u'uuids': [u'23b30649-ced2-4d08-becb-66b33d5bba61']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066301", "end": "2019-12-11 13:37:49.872850", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGZ0oGuSmFjAMZ8B78ARok21wY8YaRNd1s"], "labels": [], "masters": [], "uuids": ["23b30649-ced2-4d08-becb-66b33d5bba61"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:48.806549", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:51.060 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfMrldHknSdQ6dVDCgZZ3sFxOwf43Jk7vd'], u'uuids': [u'ceec1d7e-0ba7-4c48-b771-a27b4928ec6a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.085281", "end": "2019-12-11 13:37:51.018978", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfMrldHknSdQ6dVDCgZZ3sFxOwf43Jk7vd"], "labels": [], "masters": [], "uuids": ["ceec1d7e-0ba7-4c48-b771-a27b4928ec6a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:49.933697", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:51.324 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGjJrBEzFfpM4iIswb7ObiULBZMfNA8Bgx'], u'uuids': [u'52066aa3-aad1-4e35-8648-f51105f41a9c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.077343", "end": "2019-12-11 13:37:51.290088", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGjJrBEzFfpM4iIswb7ObiULBZMfNA8Bgx"], "labels": [], "masters": [], "uuids": ["52066aa3-aad1-4e35-8648-f51105f41a9c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:50.212745", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:52.421 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfVGobgMm3dn4p2eMQpOXjfcRB4ughKOgz'], u'uuids': [u'42e746fd-2f9a-42f5-9f23-4f27f567f5b4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056586", "end": "2019-12-11 13:37:52.385390", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfVGobgMm3dn4p2eMQpOXjfcRB4ughKOgz"], "labels": [], "masters": [], "uuids": ["42e746fd-2f9a-42f5-9f23-4f27f567f5b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:51.328804", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:52.687 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwG03Iw2Cxb0dduZPQkXQOb0kaRJBmyMhAv'], u'uuids': [u'94f94dec-89da-4cfa-bc73-4185a1cd1e4d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.055236", "end": "2019-12-11 13:37:52.650281", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwG03Iw2Cxb0dduZPQkXQOb0kaRJBmyMhAv"], "labels": [], "masters": [], "uuids": ["94f94dec-89da-4cfa-bc73-4185a1cd1e4d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:51.595045", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:53.840 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfSIoYb9DHIqTZiXZNEtOP7vPSY4ogIHNY'], u'uuids': [u'1194c90b-675d-4d37-afb4-a385064826ea']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.079771", "end": "2019-12-11 13:37:53.797113", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfSIoYb9DHIqTZiXZNEtOP7vPSY4ogIHNY"], "labels": [], "masters": [], "uuids": ["1194c90b-675d-4d37-afb4-a385064826ea"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:52.717342", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:53.903 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:53 +0000 (0:00:08.705) 0:04:27.657 **** 2019-12-11T13:37:53.955 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-11T13:37:53.957 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTME', u'wwn-0x5000c5009293e56f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XTME', u'wwn': u'0x5000c5009293e56f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', u'wwn-0x5000c5009293e56f-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-11T13:37:53.958 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:54.102 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-11T13:37:54.103 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGQwTRMUKhN0eRwC82L7VZkyqTz3Fpcn1Z'], u'uuids': [u'ac2a38af-5734-435e-82fd-f08ee767a760']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.061194", "end": "2019-12-11 13:37:54.041284", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGQwTRMUKhN0eRwC82L7VZkyqTz3Fpcn1Z"], "labels": [], "masters": [], "uuids": ["ac2a38af-5734-435e-82fd-f08ee767a760"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:52.980090", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-11T13:37:54.183 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:54 +0000 (0:00:00.280) 0:04:27.938 **** 2019-12-11T13:37:54.239 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-11T13:37:54.241 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QAQQ', u'wwn-0x5000c50091e0ab90'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QAQQ', u'wwn': u'0x5000c50091e0ab90', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1', u'wwn-0x5000c50091e0ab90-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ", "wwn-0x5000c50091e0ab90"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1", "wwn-0x5000c50091e0ab90-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAQQ", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-11T13:37:54.242 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e0ab90"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:54.354 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-yJmbs3-l4fT-DEuU-RMxH-CqVc-9eFr-8Fge1t', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', u'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.063713", "end": "2019-12-11 13:37:54.297090", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-yJmbs3-l4fT-DEuU-RMxH-CqVc-9eFr-8Fge1t", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:54.233377", "stderr": 2019-12-11T13:37:54.356 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0574141 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0574141 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:54.616 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-E3XEef-iq3L-5moX-JiRO-1gs7-gmqb-FoaFKN', u'nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN', u'nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054490", "end": "2019-12-11 13:37:54.572771", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-E3XEef-iq3L-5moX-JiRO-1gs7-gmqb-FoaFKN", "nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN", "nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:54.518281", "stderr": 2019-12-11T13:37:54.618 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0481762 s, 2.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0481762 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:54.870 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfgPdtKM8WgUWasO7slfWxNrNU6N0dUYXq'], u'uuids': [u'f36daead-068e-473b-9c74-9cccf89d66dd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.196410", "end": "2019-12-11 13:37:54.819399", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfgPdtKM8WgUWasO7slfWxNrNU6N0dUYXq"], "labels": [], "masters": [], "uuids": ["f36daead-068e-473b-9c74-9cccf89d66dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:54.622989", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.189602 s, 608 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.189602 s, 608 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:55.127 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGSNGbSXL0iWb2DmUCQK6tlQJc2U3n1Qy9'], u'uuids': [u'0928b6b3-ad80-42fa-9a93-a3073ddb5d8a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.182322", "end": "2019-12-11 13:37:55.098391", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGSNGbSXL0iWb2DmUCQK6tlQJc2U3n1Qy9"], "labels": [], "masters": [], "uuids": ["0928b6b3-ad80-42fa-9a93-a3073ddb5d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:54.916069", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.175467 s, 657 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.175467 s, 657 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:55.385 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfsqS6rWQNJhm6yd9RmsLYvGFCnT26mC9X'], u'uuids': [u'5fcd4ab1-278d-4798-813b-78dbd62fdbd2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.197217", "end": "2019-12-11 13:37:55.344907", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfsqS6rWQNJhm6yd9RmsLYvGFCnT26mC9X"], "labels": [], "masters": [], "uuids": ["5fcd4ab1-278d-4798-813b-78dbd62fdbd2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:55.147690", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191609 s, 602 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191609 s, 602 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:55.639 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGZ0oGuSmFjAMZ8B78ARok21wY8YaRNd1s'], u'uuids': [u'23b30649-ced2-4d08-becb-66b33d5bba61']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.192724", "end": "2019-12-11 13:37:55.601512", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGZ0oGuSmFjAMZ8B78ARok21wY8YaRNd1s"], "labels": [], "masters": [], "uuids": ["23b30649-ced2-4d08-becb-66b33d5bba61"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:55.408788", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18616 s, 620 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18616 s, 620 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:55.927 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfMrldHknSdQ6dVDCgZZ3sFxOwf43Jk7vd'], u'uuids': [u'ceec1d7e-0ba7-4c48-b771-a27b4928ec6a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.207170", "end": "2019-12-11 13:37:55.880632", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfMrldHknSdQ6dVDCgZZ3sFxOwf43Jk7vd"], "labels": [], "masters": [], "uuids": ["ceec1d7e-0ba7-4c48-b771-a27b4928ec6a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:55.673462", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.200265 s, 576 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.200265 s, 576 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:56.160 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGjJrBEzFfpM4iIswb7ObiULBZMfNA8Bgx'], u'uuids': [u'52066aa3-aad1-4e35-8648-f51105f41a9c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.202218", "end": "2019-12-11 13:37:56.121086", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGjJrBEzFfpM4iIswb7ObiULBZMfNA8Bgx"], "labels": [], "masters": [], "uuids": ["52066aa3-aad1-4e35-8648-f51105f41a9c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:55.918868", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.195835 s, 589 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.195835 s, 589 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:56.482 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfVGobgMm3dn4p2eMQpOXjfcRB4ughKOgz'], u'uuids': [u'42e746fd-2f9a-42f5-9f23-4f27f567f5b4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.206237", "end": "2019-12-11 13:37:56.441899", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfVGobgMm3dn4p2eMQpOXjfcRB4ughKOgz"], "labels": [], "masters": [], "uuids": ["42e746fd-2f9a-42f5-9f23-4f27f567f5b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:56.235662", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.199753 s, 577 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.199753 s, 577 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:56.698 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwG03Iw2Cxb0dduZPQkXQOb0kaRJBmyMhAv'], u'uuids': [u'94f94dec-89da-4cfa-bc73-4185a1cd1e4d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.196487", "end": "2019-12-11 13:37:56.656694", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwG03Iw2Cxb0dduZPQkXQOb0kaRJBmyMhAv"], "labels": [], "masters": [], "uuids": ["94f94dec-89da-4cfa-bc73-4185a1cd1e4d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:56.460207", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.189795 s, 608 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.189795 s, 608 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:56.982 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfSIoYb9DHIqTZiXZNEtOP7vPSY4ogIHNY'], u'uuids': [u'1194c90b-675d-4d37-afb4-a385064826ea']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GX400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.167973", "end": "2019-12-11 13:37:56.932260", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JrUUfwn2xt45oX4oDdmi224HQz5J16RfSIoYb9DHIqTZiXZNEtOP7vPSY4ogIHNY"], "labels": [], "masters": [], "uuids": ["1194c90b-675d-4d37-afb4-a385064826ea"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GX400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:56.764287", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.161626 s, 714 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.161626 s, 714 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:57.044 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:57 +0000 (0:00:02.861) 0:04:30.799 **** 2019-12-11T13:37:57.189 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGQwTRMUKhN0eRwC82L7VZkyqTz3Fpcn1Z'], u'uuids': [u'ac2a38af-5734-435e-82fd-f08ee767a760']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040115400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.171157", "end": "2019-12-11 13:37:57.141564", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JDG60OzGBgzH1NqwO0e9b2u4JAi7hFwGQwTRMUKhN0eRwC82L7VZkyqTz3Fpcn1Z"], "labels": [], "masters": [], "uuids": ["ac2a38af-5734-435e-82fd-f08ee767a760"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040115400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-11 13:37:56.970407", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.165576 s, 697 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.165576 s, 697 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:57.253 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:57 +0000 (0:00:00.208) 0:04:31.008 **** 2019-12-11T13:37:57.434 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-11T13:37:57.441 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.079020", "end": "2019-12-11 13:37:57.383174", "rc": 0, "start": "2019-12-11 13:37:57.304154", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:57.478 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:57 +0000 (0:00:00.225) 0:04:31.233 **** 2019-12-11T13:37:57.684 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.087022", "end": "2019-12-11 13:37:57.620794", "rc": 0, "start": "2019-12-11 13:37:57.533772", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:57.725 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:57 +0000 (0:00:00.245) 0:04:31.479 **** 2019-12-11T13:37:57.870 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-11T13:37:57.874 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.065101", "end": "2019-12-11 13:37:57.834816", "rc": 0, "start": "2019-12-11 13:37:57.769715", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:57.936 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:57 +0000 (0:00:00.211) 0:04:31.691 **** 2019-12-11T13:37:57.988 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-11T13:37:58.050 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.112) 0:04:31.803 **** 2019-12-11T13:37:58.088 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-11T13:37:58.090 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.133 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.085) 0:04:31.889 **** 2019-12-11T13:37:58.143 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-11T13:37:58.145 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050502", "end": "2019-12-11 13:37:58.070858", "rc": 0, "start": "2019-12-11 13:37:58.020356", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:37:58.203 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.069) 0:04:31.959 **** 2019-12-11T13:37:58.211 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-11T13:37:58.214 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.258 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.052) 0:04:32.011 **** 2019-12-11T13:37:58.263 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-11T13:37:58.315 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.059) 0:04:32.070 **** 2019-12-11T13:37:58.322 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-11T13:37:58.324 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.381 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.065) 0:04:32.136 **** 2019-12-11T13:37:58.389 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.438 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.057) 0:04:32.193 **** 2019-12-11T13:37:58.446 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-11T13:37:58.447 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.500 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.061) 0:04:32.255 **** 2019-12-11T13:37:58.513 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-11T13:37:58.514 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.562 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.062) 0:04:32.318 **** 2019-12-11T13:37:58.591 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-11T13:37:58.593 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.650 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.086) 0:04:32.405 **** 2019-12-11T13:37:58.694 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:58.741 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.091) 0:04:32.496 **** 2019-12-11T13:37:58.857 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-11T13:37:58.859 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:37:58.922 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:58 +0000 (0:00:00.180) 0:04:32.677 **** 2019-12-11T13:37:59.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-11T13:37:59.009 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={u'block_used': 13037553, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286931, u'size_available': 930967269376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286931, "block_size": 4096, "block_total": 240324484, "block_used": 13037553, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967269376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.048 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.126) 0:04:32.803 **** 2019-12-11T13:37:59.077 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-11T13:37:59.078 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-11T13:37:59.122 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.073) 0:04:32.877 **** 2019-12-11T13:37:59.132 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.204 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.078) 0:04:32.956 **** 2019-12-11T13:37:59.207 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-11T13:37:59.209 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={u'block_used': 13037660, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286824, u'size_available': 930966831104, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286824, "block_size": 4096, "block_total": 240324484, "block_used": 13037660, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966831104, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.257 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.056) 0:04:33.012 **** 2019-12-11T13:37:59.266 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-11T13:37:59.267 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.329 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.071) 0:04:33.084 **** 2019-12-11T13:37:59.335 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-11T13:37:59.337 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.391 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.062) 0:04:33.147 **** 2019-12-11T13:37:59.400 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-11T13:37:59.402 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.441 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.049) 0:04:33.197 **** 2019-12-11T13:37:59.450 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.497 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.055) 0:04:33.253 **** 2019-12-11T13:37:59.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-11T13:37:59.508 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.552 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.053) 0:04:33.307 **** 2019-12-11T13:37:59.557 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-11T13:37:59.559 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.605 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.053) 0:04:33.360 **** 2019-12-11T13:37:59.611 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-11T13:37:59.613 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.656 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.046) 0:04:33.407 **** 2019-12-11T13:37:59.659 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-11T13:37:59.660 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.714 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.060) 0:04:33.468 **** 2019-12-11T13:37:59.719 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-11T13:37:59.720 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.771 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.057) 0:04:33.526 **** 2019-12-11T13:37:59.779 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.818 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.047) 0:04:33.573 **** 2019-12-11T13:37:59.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-11T13:37:59.872 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:37:59.944 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:37:59 +0000 (0:00:00.126) 0:04:33.700 **** 2019-12-11T13:38:00.687 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-11T13:38:00.688 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-11T13:38:00.691 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-11T13:38:00.784 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:00 +0000 (0:00:00.839) 0:04:34.540 **** 2019-12-11T13:38:00.827 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:00 +0000 (0:00:00.042) 0:04:34.582 **** 2019-12-11T13:38:01.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:01.676 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:02.143 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:02.156 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:02.629 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:02.649 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:03.135 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:03.148 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:03.616 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:03.677 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:03 +0000 (0:00:02.850) 0:04:37.433 **** 2019-12-11T13:38:03.692 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-11T13:38:03.728 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:03 +0000 (0:00:00.050) 0:04:37.483 **** 2019-12-11T13:38:04.035 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-11T13:38:04.037 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-11T13:38:04.081 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:04 +0000 (0:00:00.353) 0:04:37.837 **** 2019-12-11T13:38:04.096 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-11T13:38:04.146 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:04 +0000 (0:00:00.060) 0:04:37.897 **** 2019-12-11T13:38:04.151 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-11T13:38:04.152 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:04.187 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:04.457 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:04.511 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:04.803 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:04.826 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:05.151 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:05.186 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:05.496 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:05.546 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:05 +0000 (0:00:01.404) 0:04:39.301 **** 2019-12-11T13:38:05.553 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-11T13:38:05.599 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:05 +0000 (0:00:00.053) 0:04:39.355 **** 2019-12-11T13:38:05.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-11T13:38:05.886 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:38:05.934 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:05 +0000 (0:00:00.334) 0:04:39.689 **** 2019-12-11T13:38:05.944 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-11T13:38:05.984 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:05 +0000 (0:00:00.049) 0:04:39.739 **** 2019-12-11T13:38:05.992 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-11T13:38:05.994 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-11T13:38:06.038 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:06 +0000 (0:00:00.052) 0:04:39.792 **** 2019-12-11T13:38:06.055 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-11T13:38:06.118 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:06 +0000 (0:00:00.081) 0:04:39.873 **** 2019-12-11T13:38:06.807 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi073.front.sepia.ceph.com] => {"changed": true} 2019-12-11T13:38:06.868 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:06 +0000 (0:00:00.749) 0:04:40.622 **** 2019-12-11T13:38:06.877 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true} 2019-12-11T13:38:06.940 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:06 +0000 (0:00:00.073) 0:04:40.696 **** 2019-12-11T13:38:07.643 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-11T13:38:07.645 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-11T13:38:07.721 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.774) 0:04:41.470 **** 2019-12-11T13:38:07.725 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-11T13:38:07.776 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.061) 0:04:41.531 **** 2019-12-11T13:38:07.784 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-11T13:38:07.785 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:07.829 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.052) 0:04:41.584 **** 2019-12-11T13:38:07.836 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:07.885 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.056) 0:04:41.640 **** 2019-12-11T13:38:07.896 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:07.945 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.059) 0:04:41.700 **** 2019-12-11T13:38:07.952 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.000 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:07 +0000 (0:00:00.055) 0:04:41.756 **** 2019-12-11T13:38:08.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-11T13:38:08.008 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.071 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.069) 0:04:41.825 **** 2019-12-11T13:38:08.081 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.124 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.052) 0:04:41.878 **** 2019-12-11T13:38:08.133 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-11T13:38:08.134 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.199 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.075) 0:04:41.954 **** 2019-12-11T13:38:08.206 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.244 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.045) 0:04:41.999 **** 2019-12-11T13:38:08.253 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-11T13:38:08.255 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.304 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.059) 0:04:42.059 **** 2019-12-11T13:38:08.314 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.361 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.057) 0:04:42.116 **** 2019-12-11T13:38:08.368 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-11T13:38:08.369 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.414 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.052) 0:04:42.169 **** 2019-12-11T13:38:08.423 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.461 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.047) 0:04:42.216 **** 2019-12-11T13:38:08.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-11T13:38:08.469 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.527 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.065) 0:04:42.282 **** 2019-12-11T13:38:08.536 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:08.584 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:08 +0000 (0:00:00.057) 0:04:42.339 **** 2019-12-11T13:38:09.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-11T13:38:09.004 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-11T13:38:09.050 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.465) 0:04:42.805 **** 2019-12-11T13:38:09.082 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-11T13:38:09.083 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:09.145 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.095) 0:04:42.900 **** 2019-12-11T13:38:09.155 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-11T13:38:09.157 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-11T13:38:09.210 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.064) 0:04:42.965 **** 2019-12-11T13:38:09.216 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-11T13:38:09.218 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:09.265 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.055) 0:04:43.020 **** 2019-12-11T13:38:09.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-11T13:38:09.279 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:09.325 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.060) 0:04:43.080 **** 2019-12-11T13:38:09.366 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-11T13:38:09.367 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:09.425 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:09 +0000 (0:00:00.100) 0:04:43.181 **** 2019-12-11T13:38:10.278 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-11T13:38:10.318 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:10 +0000 (0:00:00.892) 0:04:44.074 **** 2019-12-11T13:38:10.349 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-11T13:38:10.350 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:10.406 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:10 +0000 (0:00:00.087) 0:04:44.161 **** 2019-12-11T13:38:10.413 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-11T13:38:10.414 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-11T13:38:10.466 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:10 +0000 (0:00:00.059) 0:04:44.221 **** 2019-12-11T13:38:10.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-11T13:38:10.509 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:10.554 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:10 +0000 (0:00:00.088) 0:04:44.309 **** 2019-12-11T13:38:10.971 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-11T13:38:10.982 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target -.mount ntpdate.service sntp.service system.slice syslog.target tmp.mount systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-11T13:38:10.984 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-11T13:38:10.986 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-11T13:38:11.016 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:11 +0000 (0:00:00.461) 0:04:44.771 **** 2019-12-11T13:38:11.106 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target tmp.mount system.slice basic.target ntpdate.service sntp.service systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-11T13:38:11.108 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-11T13:38:11.110 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-11T13:38:11.177 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:11 +0000 (0:00:00.160) 0:04:44.932 **** 2019-12-11T13:38:12.022 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-11T13:38:12.023 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-11T13:38:12.087 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.910) 0:04:45.842 **** 2019-12-11T13:38:12.125 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-11T13:38:12.127 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:12.166 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.078) 0:04:45.921 **** 2019-12-11T13:38:12.173 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-11T13:38:12.174 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-11T13:38:12.216 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.050) 0:04:45.971 **** 2019-12-11T13:38:12.228 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:12.263 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.046) 0:04:46.018 **** 2019-12-11T13:38:12.270 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-11T13:38:12.273 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:12.314 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.050) 0:04:46.069 **** 2019-12-11T13:38:12.344 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:12.382 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.068) 0:04:46.138 **** 2019-12-11T13:38:12.580 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-11T13:38:12.581 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-11T13:38:12.620 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.237) 0:04:46.375 **** 2019-12-11T13:38:12.740 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-11T13:38:12.783 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:12 +0000 (0:00:00.161) 0:04:46.537 **** 2019-12-11T13:38:13.652 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-11T13:38:13.653 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-11T13:38:13.697 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:13 +0000 (0:00:00.915) 0:04:47.452 **** 2019-12-11T13:38:13.759 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-11T13:38:13.816 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:13 +0000 (0:00:00.118) 0:04:47.572 **** 2019-12-11T13:38:15.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-11T13:38:15.579 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-11T13:38:15.638 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:01.822) 0:04:49.394 **** 2019-12-11T13:38:15.651 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-11T13:38:15.694 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:00.055) 0:04:49.450 **** 2019-12-11T13:38:15.702 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-11T13:38:15.704 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:15.763 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:00.068) 0:04:49.518 **** 2019-12-11T13:38:15.772 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:15.813 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:00.050) 0:04:49.569 **** 2019-12-11T13:38:15.820 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-11T13:38:15.822 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-11T13:38:15.875 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:00.061) 0:04:49.630 **** 2019-12-11T13:38:15.881 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-11T13:38:15.921 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:15 +0000 (0:00:00.045) 0:04:49.676 **** 2019-12-11T13:38:16.223 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-11T13:38:16.225 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-11T13:38:16.274 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.353) 0:04:50.029 **** 2019-12-11T13:38:16.283 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-11T13:38:16.325 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.050) 0:04:50.080 **** 2019-12-11T13:38:16.332 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-11T13:38:16.334 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:16.374 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.048) 0:04:50.128 **** 2019-12-11T13:38:16.380 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:16.420 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.047) 0:04:50.175 **** 2019-12-11T13:38:16.429 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-11T13:38:16.431 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-11T13:38:16.476 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.055) 0:04:50.231 **** 2019-12-11T13:38:16.482 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-11T13:38:16.522 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.046) 0:04:50.278 **** 2019-12-11T13:38:16.529 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-11T13:38:16.531 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:16.573 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.050) 0:04:50.328 **** 2019-12-11T13:38:16.581 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:16.620 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.046) 0:04:50.375 **** 2019-12-11T13:38:16.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-11T13:38:16.975 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:16 +0000 (0:00:00.355) 0:04:50.731 **** 2019-12-11T13:38:16.983 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-11T13:38:17.023 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.047) 0:04:50.778 **** 2019-12-11T13:38:17.305 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-11T13:38:17.308 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-11T13:38:17.383 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.360) 0:04:51.139 **** 2019-12-11T13:38:17.390 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-11T13:38:17.437 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.053) 0:04:51.192 **** 2019-12-11T13:38:17.443 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-11T13:38:17.445 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.485 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.047) 0:04:51.240 **** 2019-12-11T13:38:17.493 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.547 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.061) 0:04:51.302 **** 2019-12-11T13:38:17.555 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-11T13:38:17.556 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.558 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.560 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.561 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.563 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.609 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.062) 0:04:51.364 **** 2019-12-11T13:38:17.617 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.619 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.623 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.624 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.626 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.680 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.071) 0:04:51.436 **** 2019-12-11T13:38:17.693 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-11T13:38:17.694 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.695 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.697 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.698 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.700 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.747 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.066) 0:04:51.502 **** 2019-12-11T13:38:17.760 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.772 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.773 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.811 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.064) 0:04:51.566 **** 2019-12-11T13:38:17.817 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-11T13:38:17.819 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.864 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.052) 0:04:51.619 **** 2019-12-11T13:38:17.871 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.929 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.064) 0:04:51.684 **** 2019-12-11T13:38:17.937 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-11T13:38:17.938 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:17.994 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:17 +0000 (0:00:00.065) 0:04:51.750 **** 2019-12-11T13:38:18.003 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.059 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.063) 0:04:51.814 **** 2019-12-11T13:38:18.069 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-11T13:38:18.071 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.119 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.060) 0:04:51.874 **** 2019-12-11T13:38:18.126 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.170 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.050) 0:04:51.924 **** 2019-12-11T13:38:18.176 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-11T13:38:18.178 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.218 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.048) 0:04:51.973 **** 2019-12-11T13:38:18.227 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.263 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.045) 0:04:52.018 **** 2019-12-11T13:38:18.270 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-11T13:38:18.272 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.316 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.052) 0:04:52.071 **** 2019-12-11T13:38:18.323 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.367 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.051) 0:04:52.122 **** 2019-12-11T13:38:18.376 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.421 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.053) 0:04:52.176 **** 2019-12-11T13:38:18.429 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.470 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.049) 0:04:52.225 **** 2019-12-11T13:38:18.477 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-11T13:38:18.479 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.522 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.051) 0:04:52.277 **** 2019-12-11T13:38:18.528 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.570 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.048) 0:04:52.325 **** 2019-12-11T13:38:18.576 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-11T13:38:18.578 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.619 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.048) 0:04:52.374 **** 2019-12-11T13:38:18.626 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-11T13:38:18.686 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:18 +0000 (0:00:00.067) 0:04:52.441 **** 2019-12-11T13:38:18.965 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi150.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.013251", "end": "2019-12-11 13:38:18.911106", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-11 13:38:18.897855", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.053 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016851", "end": "2019-12-11 13:38:19.004800", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-11 13:38:18.987949", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.255 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006490", "end": "2019-12-11 13:38:19.220010", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-11 13:38:19.213520", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.341 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007900", "end": "2019-12-11 13:38:19.306232", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-11 13:38:19.298332", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.574 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006166", "end": "2019-12-11 13:38:19.538371", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-11 13:38:19.532205", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.657 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007722", "end": "2019-12-11 13:38:19.624810", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-11 13:38:19.617088", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.908 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007838", "end": "2019-12-11 13:38:19.867457", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-11 13:38:19.859619", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:19.951 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:19 +0000 (0:00:01.264) 0:04:53.706 **** 2019-12-11T13:38:19.992 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-11T13:38:20.029 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:20 +0000 (0:00:00.078) 0:04:53.785 **** 2019-12-11T13:38:20.036 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-11T13:38:20.037 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007780", "end": "2019-12-11 13:38:19.948231", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-11 13:38:19.940451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-11T13:38:20.079 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:20 +0000 (0:00:00.049) 0:04:53.834 **** 2019-12-11T13:38:20.107 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-11T13:38:20.147 INFO:teuthology.task.ansible.out:Wednesday 11 December 2019 13:38:20 +0000 (0:00:00.067) 0:04:53.902 **** 2019-12-11T13:38:20.349 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-11T13:38:20.350 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-11T13:38:20.474 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-11T13:38:20.587 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2019-12-11T13:38:20.589 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-12-11T13:38:20.590 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-11T13:38:20.592 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2019-12-11T13:38:20.594 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi073.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 smithi150.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 Wednesday 11 December 2019 13:38:20 +0000 (0:00:00.445) 0:04:54.348 **** =============================================================================== 2019-12-11T13:38:20.595 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 36.06s users : Update authorized_keys using the keys repo --------------------- 35.30s common : nrpe - Ensure SELinux policy is up to date -------------------- 26.00s testnode : Install packages -------------------------------------------- 18.30s users : Remove revoked users ------------------------------------------- 16.72s common : Update yum cache ---------------------------------------------- 12.85s testnode : Zap all non-root disks --------------------------------------- 8.71s testnode : Ensure ceph packages are not present. ------------------------ 8.38s common : nrpe - Remove SELinux policy package --------------------------- 8.01s common : nrpe - Load SELinux policy package ----------------------------- 7.79s common : Make sure smartmontools is installed --------------------------- 3.42s testnode : Ensure ceph dependency packages are not present. ------------- 3.27s Gathering Facts --------------------------------------------------------- 2.92s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.86s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.85s testnode : Create logical volume(s) ------------------------------------- 2.85s ansible-managed : Add authorized keys for the ansible user. ------------- 2.78s users : Update authorized_keys for each user with literal keys ---------- 2.59s testnode : Rebuild rpmdb ------------------------------------------------ 2.41s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.31s 2019-12-11T13:38:20.914 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2019-12-11T13:38:20.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:38:20.917 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi073.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:38:21.014 INFO:teuthology.orchestra.run.smithi073:> true 2019-12-11T13:38:21.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-11T13:38:21.406 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi150.front.sepia.ceph.com', 'timeout': 60} 2019-12-11T13:38:21.500 INFO:teuthology.orchestra.run.smithi150:> true 2019-12-11T13:38:21.843 INFO:teuthology.run_tasks:Running task clock... 2019-12-11T13:38:21.854 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-11T13:38:21.854 INFO:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-11T13:38:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-11T13:38:32.086 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.002616s 2019-12-11T13:38:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit not found. 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:32.210 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:32.211 INFO:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-11T13:38:32.347 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-11T13:38:42.434 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew -0.000416s 2019-12-11T13:38:42.471 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit not found. 2019-12-11T13:38:42.549 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2019-12-11T13:38:42.549 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2019-12-11T13:38:42.550 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:42.550 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:42.550 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:42.550 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-11T13:38:42.551 INFO:teuthology.run_tasks:Running task install... 2019-12-11T13:38:42.584 DEBUG:teuthology.task.install:project ceph 2019-12-11T13:38:42.585 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b'}} 2019-12-11T13:38:42.585 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b'} 2019-12-11T13:38:42.585 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-12-11T13:38:42.592 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-12-11T13:38:42.592 INFO:teuthology.task.install:extra packages: [] 2019-12-11T13:38:42.592 INFO:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2019-12-11T13:38:42.768 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS 2019-12-11T13:38:42.770 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:38:42.770 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2019-12-11T13:38:42.771 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-11T13:38:42.771 INFO:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2019-12-11T13:38:42.917 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS 2019-12-11T13:38:42.917 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:38:42.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:38:42.922 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2019-12-11T13:38:42.923 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:38:42.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-11T13:38:42.923 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2019-12-11T13:38:43.033 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2019-12-11T13:38:43.035 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:38:43.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:38:43.076 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-abhi-testing-2019-12-04-1433/827e03c8a6b1e17d93dcaf79724437bac291c35b/centos/7/flavors/notcmalloc/ 2019-12-11T13:38:43.077 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7936.g827e03c 2019-12-11T13:38:43.186 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-abhi-testing-2019-12-04-1433/827e03c8a6b1e17d93dcaf79724437bac291c35b/centos/7/flavors/notcmalloc/ 2019-12-11T13:38:43.186 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7936.g827e03c 2019-12-11T13:38:43.199 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-11T13:38:43.308 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-11T13:38:43.320 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-11T13:38:43.321 INFO:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/827e03c8a6b1e17d93dcaf79724437bac291c35b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-11T13:38:43.430 INFO:teuthology.orchestra.run.smithi073:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-11T13:38:43.432 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-11T13:38:43.433 INFO:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/827e03c8a6b1e17d93dcaf79724437bac291c35b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-11T13:38:43.525 INFO:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-11T13:38:43.538 INFO:teuthology.orchestra.run.smithi150:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-11T13:38:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2019-12-11T13:38:43.604 INFO:teuthology.orchestra.run.smithi073:> sudo yum clean all 2019-12-11T13:38:43.646 INFO:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-11T13:38:43.734 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2019-12-11T13:38:43.736 INFO:teuthology.orchestra.run.smithi150:> sudo yum clean all 2019-12-11T13:38:43.771 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:38:43.810 INFO:teuthology.orchestra.run.smithi073.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-11T13:38:43.810 INFO:teuthology.orchestra.run.smithi073.stdout: : lab-extras updates 2019-12-11T13:38:43.856 INFO:teuthology.orchestra.run.smithi073.stdout:Cleaning up list of fastest mirrors 2019-12-11T13:38:43.856 INFO:teuthology.orchestra.run.smithi073.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-11T13:38:43.868 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2019-12-11T13:38:43.907 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:38:43.945 INFO:teuthology.orchestra.run.smithi150.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-11T13:38:43.946 INFO:teuthology.orchestra.run.smithi150.stdout: : lab-extras updates 2019-12-11T13:38:43.992 INFO:teuthology.orchestra.run.smithi150.stdout:Cleaning up list of fastest mirrors 2019-12-11T13:38:43.992 INFO:teuthology.orchestra.run.smithi150.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-11T13:38:44.005 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw 2019-12-11T13:38:44.022 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:38:44.060 INFO:teuthology.orchestra.run.smithi073.stdout:Determining fastest mirrors 2019-12-11T13:38:44.247 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:38:44.293 INFO:teuthology.orchestra.run.smithi150.stdout:Determining fastest mirrors 2019-12-11T13:38:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:38:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:38:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:38:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:38:44.815 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:38:44.815 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:38:44.816 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:38:44.817 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:38:52.192 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:38:52.550 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:38:52.550 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:38:52.551 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.563 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.658 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:38:52.669 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.671 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.672 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.674 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.674 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.676 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.676 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.678 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.679 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:38:52.679 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-base.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.688 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.689 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.690 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.691 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.692 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.694 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.696 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-11T13:38:52.697 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-11T13:38:52.697 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-11T13:38:52.698 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librados2.x86_64 2:15.0.0-7936.g827e03c.el7 will be an update 2019-12-11T13:38:52.699 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-11T13:38:52.700 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librgw2.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.702 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:38:52.702 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.706 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.707 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.708 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.709 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.710 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.711 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.712 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.713 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.714 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.714 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.716 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:52.716 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-11T13:38:52.716 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.716 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-11T13:38:52.717 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librbd1.x86_64 2:15.0.0-7936.g827e03c.el7 will be an update 2019-12-11T13:38:52.717 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-11T13:38:52.718 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-11T13:38:52.719 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-11T13:38:52.719 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:38:52.719 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-11T13:38:52.720 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.723 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.724 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.724 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.725 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-11T13:38:52.725 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-rados.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.725 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-rbd.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.725 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-rgw.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:52.726 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-11T13:38:53.012 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:38:53.012 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:38:53.012 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.025 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.133 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.135 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.136 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.138 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.139 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.140 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.141 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:38:53.142 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-base.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.150 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.152 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.153 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.154 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.155 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-11T13:38:53.159 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-11T13:38:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-11T13:38:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librados2.x86_64 2:15.0.0-7936.g827e03c.el7 will be an update 2019-12-11T13:38:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-11T13:38:53.163 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librgw2.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:38:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.171 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.173 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.174 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.175 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.176 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.177 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:38:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-11T13:38:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.178 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-11T13:38:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librbd1.x86_64 2:15.0.0-7936.g827e03c.el7 will be an update 2019-12-11T13:38:53.179 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-11T13:38:53.180 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-11T13:38:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-11T13:38:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:38:53.182 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-11T13:38:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.183 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.184 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-11T13:38:53.185 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-rados.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-rbd.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-rgw.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:38:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-11T13:38:53.591 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:38:53.678 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:38:53.679 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:38:53.682 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:38:53.682 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:38:53.682 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:15.0.0-7936.g827e03c.el7 ceph 6.3 M 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:15.0.0-7936.g827e03c.el7 ceph 5.6 M 2019-12-11T13:38:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:15.0.0-7936.g827e03c.el7 ceph 20 M 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:15.0.0-7936.g827e03c.el7 ceph 20 k 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 489 k 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-11T13:38:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 374 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 5.5 M 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-argparse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 35 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-common x86_64 2:15.0.0-7936.g827e03c.el7 ceph 42 k 2019-12-11T13:38:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: python-cephfs x86_64 2:15.0.0-7936.g827e03c.el7 ceph 102 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: python-rados x86_64 2:15.0.0-7936.g827e03c.el7 ceph 209 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: python-rbd x86_64 2:15.0.0-7936.g827e03c.el7 ceph 199 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: python-rgw x86_64 2:15.0.0-7936.g827e03c.el7 ceph 77 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout:Updating for dependencies: 2019-12-11T13:38:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 3.5 M 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.8 M 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+20 Dependent packages) 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade ( 2 Dependent packages) 2019-12-11T13:38:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:38:53.688 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 45 M 2019-12-11T13:38:53.688 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:38:53.688 INFO:teuthology.orchestra.run.smithi150.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-11T13:38:54.049 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:38:54.135 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:38:54.135 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:38:54.138 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:38:54.138 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:38:54.138 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:38:54.138 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:38:54.138 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:15.0.0-7936.g827e03c.el7 ceph 6.3 M 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:15.0.0-7936.g827e03c.el7 ceph 5.6 M 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:15.0.0-7936.g827e03c.el7 ceph 20 M 2019-12-11T13:38:54.139 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:15.0.0-7936.g827e03c.el7 ceph 20 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 489 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-11T13:38:54.140 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 374 k 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 5.5 M 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-argparse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 35 k 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-common x86_64 2:15.0.0-7936.g827e03c.el7 ceph 42 k 2019-12-11T13:38:54.141 INFO:teuthology.orchestra.run.smithi073.stdout: python-cephfs x86_64 2:15.0.0-7936.g827e03c.el7 ceph 102 k 2019-12-11T13:38:54.142 INFO:teuthology.orchestra.run.smithi073.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-11T13:38:54.142 INFO:teuthology.orchestra.run.smithi073.stdout: python-rados x86_64 2:15.0.0-7936.g827e03c.el7 ceph 209 k 2019-12-11T13:38:54.142 INFO:teuthology.orchestra.run.smithi073.stdout: python-rbd x86_64 2:15.0.0-7936.g827e03c.el7 ceph 199 k 2019-12-11T13:38:54.142 INFO:teuthology.orchestra.run.smithi073.stdout: python-rgw x86_64 2:15.0.0-7936.g827e03c.el7 ceph 77 k 2019-12-11T13:38:54.142 INFO:teuthology.orchestra.run.smithi073.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout:Updating for dependencies: 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 3.5 M 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.8 M 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:38:54.143 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:38:54.144 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+20 Dependent packages) 2019-12-11T13:38:54.144 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade ( 2 Dependent packages) 2019-12-11T13:38:54.144 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:38:54.144 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 45 M 2019-12-11T13:38:54.144 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:38:54.145 INFO:teuthology.orchestra.run.smithi073.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-11T13:39:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:04.504 INFO:teuthology.orchestra.run.smithi150.stdout:Total 4.2 MB/s | 45 MB 00:10 2019-12-11T13:39:04.518 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:39:04.585 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:39:04.816 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:39:04.816 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:39:05.531 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-11T13:39:05.924 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-11T13:39:06.216 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-11T13:39:06.485 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:06.486 INFO:teuthology.orchestra.run.smithi073.stdout:Total 3.6 MB/s | 45 MB 00:12 2019-12-11T13:39:06.498 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:39:06.516 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-ceph-argparse-15.0.0-7936.g827e03c.el7.x86_64 4/25 2019-12-11T13:39:06.554 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:39:06.746 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:39:06.746 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:39:06.826 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-12-11T13:39:07.223 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-11T13:39:07.507 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-11T13:39:07.893 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-11T13:39:08.012 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-11T13:39:08.245 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-11T13:39:08.366 INFO:teuthology.orchestra.run.smithi150.stdout: Updating : 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 8/25 2019-12-11T13:39:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-ceph-argparse-15.0.0-7936.g827e03c.el7.x86_64 4/25 2019-12-11T13:39:08.880 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-rados-15.0.0-7936.g827e03c.el7.x86_64 9/25 2019-12-11T13:39:08.905 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-12-11T13:39:09.294 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-11T13:39:09.785 INFO:teuthology.orchestra.run.smithi150.stdout: Updating : 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 10/25 2019-12-11T13:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-11T13:39:10.159 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:librgw2-15.0.0-7936.g827e03c.el7.x86_64 11/25 2019-12-11T13:39:10.471 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 12/25 2019-12-11T13:39:10.541 INFO:teuthology.orchestra.run.smithi073.stdout: Updating : 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 8/25 2019-12-11T13:39:10.753 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-cephfs-15.0.0-7936.g827e03c.el7.x86_64 13/25 2019-12-11T13:39:11.034 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-rgw-15.0.0-7936.g827e03c.el7.x86_64 14/25 2019-12-11T13:39:11.092 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-rados-15.0.0-7936.g827e03c.el7.x86_64 9/25 2019-12-11T13:39:11.377 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-rbd-15.0.0-7936.g827e03c.el7.x86_64 15/25 2019-12-11T13:39:11.737 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:libradosstriper1-15.0.0-7936.g827e03c.el7.x86_64 16/25 2019-12-11T13:39:11.994 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-ceph-common-15.0.0-7936.g827e03c.el7.x86_64 17/25 2019-12-11T13:39:12.039 INFO:teuthology.orchestra.run.smithi073.stdout: Updating : 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 10/25 2019-12-11T13:39:12.293 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 18/25 2019-12-11T13:39:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:librgw2-15.0.0-7936.g827e03c.el7.x86_64 11/25 2019-12-11T13:39:12.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 12/25 2019-12-11T13:39:13.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-cephfs-15.0.0-7936.g827e03c.el7.x86_64 13/25 2019-12-11T13:39:13.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-rgw-15.0.0-7936.g827e03c.el7.x86_64 14/25 2019-12-11T13:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-rbd-15.0.0-7936.g827e03c.el7.x86_64 15/25 2019-12-11T13:39:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:libradosstriper1-15.0.0-7936.g827e03c.el7.x86_64 16/25 2019-12-11T13:39:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-ceph-common-15.0.0-7936.g827e03c.el7.x86_64 17/25 2019-12-11T13:39:14.771 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-12-11T13:39:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 18/25 2019-12-11T13:39:15.942 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 20/25 2019-12-11T13:39:16.501 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 21/25 2019-12-11T13:39:17.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-12-11T13:39:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 20/25 2019-12-11T13:39:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 21/25 2019-12-11T13:39:26.005 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-selinux-15.0.0-7936.g827e03c.el7.x86_64 22/25 2019-12-11T13:39:26.390 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 23/25 2019-12-11T13:39:26.676 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-11T13:39:26.991 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-11T13:39:27.105 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-rgw-15.0.0-7936.g827e03c.el7.x86_64 1/25 2019-12-11T13:39:27.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-11T13:39:27.364 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 3/25 2019-12-11T13:39:27.456 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-11T13:39:27.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 5/25 2019-12-11T13:39:27.640 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 6/25 2019-12-11T13:39:27.732 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-rbd-15.0.0-7936.g827e03c.el7.x86_64 7/25 2019-12-11T13:39:27.849 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-selinux-15.0.0-7936.g827e03c.el7.x86_64 8/25 2019-12-11T13:39:27.942 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-rados-15.0.0-7936.g827e03c.el7.x86_64 9/25 2019-12-11T13:39:28.050 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:libradosstriper1-15.0.0-7936.g827e03c.el7.x86_64 10/25 2019-12-11T13:39:28.159 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 11/25 2019-12-11T13:39:28.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-cephfs-15.0.0-7936.g827e03c.el7.x86_64 12/25 2019-12-11T13:39:28.410 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7936.g827e03c.el7.x86_64 13/25 2019-12-11T13:39:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:librgw2-15.0.0-7936.g827e03c.el7.x86_64 14/25 2019-12-11T13:39:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 15/25 2019-12-11T13:39:28.729 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-selinux-15.0.0-7936.g827e03c.el7.x86_64 22/25 2019-12-11T13:39:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 16/25 2019-12-11T13:39:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 17/25 2019-12-11T13:39:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 18/25 2019-12-11T13:39:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-ceph-common-15.0.0-7936.g827e03c.el7.x86_64 19/25 2019-12-11T13:39:29.129 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 23/25 2019-12-11T13:39:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 20/25 2019-12-11T13:39:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 21/25 2019-12-11T13:39:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 22/25 2019-12-11T13:39:29.425 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-11T13:39:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-12-11T13:39:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-11T13:39:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-11T13:39:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:39:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-11T13:39:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-argparse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: python-cephfs.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: python-rados.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: python-rbd.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: python-rgw.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-11T13:39:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:29.853 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Updated: 2019-12-11T13:39:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: librados2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:29.853 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:39:29.858 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-rgw-15.0.0-7936.g827e03c.el7.x86_64 1/25 2019-12-11T13:39:29.976 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-11T13:39:29.988 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-test 2019-12-11T13:39:30.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-radosgw-15.0.0-7936.g827e03c.el7.x86_64 3/25 2019-12-11T13:39:30.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-11T13:39:30.235 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:39:30.273 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:39:30.273 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:39:30.274 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:39:30.274 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:39:30.275 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:39:30.294 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 5/25 2019-12-11T13:39:30.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 6/25 2019-12-11T13:39:30.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-rbd-15.0.0-7936.g827e03c.el7.x86_64 7/25 2019-12-11T13:39:30.629 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-selinux-15.0.0-7936.g827e03c.el7.x86_64 8/25 2019-12-11T13:39:30.738 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-rados-15.0.0-7936.g827e03c.el7.x86_64 9/25 2019-12-11T13:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:libradosstriper1-15.0.0-7936.g827e03c.el7.x86_64 10/25 2019-12-11T13:39:30.921 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:39:30.980 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-base-15.0.0-7936.g827e03c.el7.x86_64 11/25 2019-12-11T13:39:31.097 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-cephfs-15.0.0-7936.g827e03c.el7.x86_64 12/25 2019-12-11T13:39:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7936.g827e03c.el7.x86_64 13/25 2019-12-11T13:39:31.250 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:39:31.251 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:31.251 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-test.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:31.268 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:31.298 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:31.299 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:31.300 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:31.301 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-11T13:39:31.301 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-11T13:39:31.302 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-11T13:39:31.304 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-11T13:39:31.307 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:31.307 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-11T13:39:31.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:librgw2-15.0.0-7936.g827e03c.el7.x86_64 14/25 2019-12-11T13:39:31.490 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 15/25 2019-12-11T13:39:31.616 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 16/25 2019-12-11T13:39:31.666 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:39:31.733 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 17/25 2019-12-11T13:39:31.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 18/25 2019-12-11T13:39:31.889 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:31.889 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:31.890 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:15.0.0-7936.g827e03c.el7 ceph 38 M 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-11T13:39:31.891 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:31.892 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:39:31.892 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:31.892 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:39:31.892 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:31.893 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 38 M 2019-12-11T13:39:31.893 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 134 M 2019-12-11T13:39:31.893 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:39:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-ceph-common-15.0.0-7936.g827e03c.el7.x86_64 19/25 2019-12-11T13:39:32.052 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 20/25 2019-12-11T13:39:32.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 21/25 2019-12-11T13:39:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-common-15.0.0-7936.g827e03c.el7.x86_64 22/25 2019-12-11T13:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-12-11T13:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-11T13:39:32.762 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-11T13:39:32.762 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:32.762 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:39:32.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.762 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-11T13:39:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-11T13:39:32.764 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-argparse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-common.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-cephfs.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-rados.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-rbd.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: python-rgw.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-11T13:39:32.765 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:32.766 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Updated: 2019-12-11T13:39:32.766 INFO:teuthology.orchestra.run.smithi073.stdout: librados2.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.766 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:32.766 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:32.766 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:39:32.890 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2019-12-11T13:39:33.201 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:39:33.247 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:39:33.248 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:39:33.249 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:39:33.249 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:39:33.249 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:39:33.894 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:39:34.232 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:39:34.233 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:34.233 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-test.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:34.250 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:34.279 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:34.280 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:34.282 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:34.282 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-11T13:39:34.282 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-11T13:39:34.283 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-11T13:39:34.285 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-11T13:39:34.288 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:34.288 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-11T13:39:34.646 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:39:34.676 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:34.676 INFO:teuthology.orchestra.run.smithi150.stdout:Total 14 MB/s | 38 MB 00:02 2019-12-11T13:39:34.679 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:39:34.701 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:39:34.782 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:39:34.783 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:39:34.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:34.866 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:39:34.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:15.0.0-7936.g827e03c.el7 ceph 38 M 2019-12-11T13:39:34.867 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:39:34.868 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:34.869 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:39:34.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:34.869 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2019-12-11T13:39:34.869 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 134 M 2019-12-11T13:39:34.870 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:39:35.501 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-11T13:39:35.778 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-11T13:39:36.115 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-11T13:39:40.112 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-11T13:39:40.433 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 5/5 2019-12-11T13:39:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 1/5 2019-12-11T13:39:40.648 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-11T13:39:40.807 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-11T13:39:40.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-11T13:39:41.418 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-11T13:39:41.418 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-11T13:39:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:41.420 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:39:41.554 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph 2019-12-11T13:39:41.781 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:39:41.820 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:39:41.821 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:39:41.822 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:39:41.822 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:39:41.822 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:39:42.479 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:39:42.811 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:39:42.811 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.812 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:42.814 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.844 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.845 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.846 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.847 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.847 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:42.857 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:42.859 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.860 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.862 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.863 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.864 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.865 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:42.866 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:42.868 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:42.873 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.873 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-11T13:39:42.874 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-11T13:39:42.874 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-11T13:39:42.875 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:42.876 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:42.877 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:42.878 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:42.879 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:42.879 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-11T13:39:42.880 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-11T13:39:42.881 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-11T13:39:42.881 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-11T13:39:42.882 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-11T13:39:42.882 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.883 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-11T13:39:42.883 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-11T13:39:42.883 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-11T13:39:42.884 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-11T13:39:42.885 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-11T13:39:42.885 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-11T13:39:42.886 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-11T13:39:42.887 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-11T13:39:42.887 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.887 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-11T13:39:42.888 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-11T13:39:42.888 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:39:42.888 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-11T13:39:43.247 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:39:43.470 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:43.470 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:43.473 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:15.0.0-7936.g827e03c.el7 ceph 2.0 k 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.9 M 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.7 M 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:15.0.0-7936.g827e03c.el7 ceph 4.4 M 2019-12-11T13:39:43.474 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:15.0.0-7936.g827e03c.el7 ceph 16 M 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-11T13:39:43.475 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-11T13:39:43.476 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:39:43.477 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+21 Dependent packages) 2019-12-11T13:39:43.478 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:39:43.478 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 28 M 2019-12-11T13:39:43.478 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 87 M 2019-12-11T13:39:43.479 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:39:48.163 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:48.164 INFO:teuthology.orchestra.run.smithi150.stdout:Total 5.9 MB/s | 28 MB 00:04 2019-12-11T13:39:48.191 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:39:48.206 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:48.206 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.9 MB/s | 38 MB 00:13 2019-12-11T13:39:48.209 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:39:48.229 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:39:48.239 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:39:48.313 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:39:48.314 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:39:48.472 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:39:48.472 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:39:49.687 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-11T13:39:49.763 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-11T13:39:50.031 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-11T13:39:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-11T13:39:50.394 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-11T13:39:50.772 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-11T13:39:51.174 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mon-15.0.0-7936.g827e03c.el7.x86_64 4/22 2019-12-11T13:39:51.633 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-12-11T13:39:51.971 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-12-11T13:39:52.431 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-12-11T13:39:53.005 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-12-11T13:39:53.578 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mds-15.0.0-7936.g827e03c.el7.x86_64 9/22 2019-12-11T13:39:53.910 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/22 2019-12-11T13:39:54.310 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-12-11T13:39:54.478 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-11T13:39:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-12-11T13:39:54.856 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 5/5 2019-12-11T13:39:54.928 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-12-11T13:39:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-test-15.0.0-7936.g827e03c.el7.x86_64 1/5 2019-12-11T13:39:55.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-11T13:39:55.189 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-11T13:39:55.261 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-11T13:39:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-11T13:39:55.741 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-11T13:39:55.741 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:55.741 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:39:55.741 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:55.742 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:39:55.869 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2019-12-11T13:39:56.052 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:39:56.090 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:39:56.091 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:39:56.092 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:39:56.092 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:39:56.092 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:39:56.679 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:39:57.002 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:39:57.003 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.003 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:57.005 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.035 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.036 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.037 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.038 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.038 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:57.048 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:57.050 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.051 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.053 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.054 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.055 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.056 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:39:57.057 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:57.059 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:39:57.064 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.064 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-11T13:39:57.065 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-11T13:39:57.066 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-11T13:39:57.066 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:57.067 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:57.068 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:57.069 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-11T13:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-11T13:39:57.071 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-11T13:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-11T13:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-11T13:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-11T13:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-11T13:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-11T13:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-11T13:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-11T13:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-11T13:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-11T13:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-11T13:39:57.078 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-11T13:39:57.078 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.078 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-11T13:39:57.079 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-11T13:39:57.079 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:39:57.079 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-11T13:39:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-11T13:39:57.435 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:39:57.586 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-osd-15.0.0-7936.g827e03c.el7.x86_64 16/22 2019-12-11T13:39:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:57.655 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:39:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:39:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:15.0.0-7936.g827e03c.el7 ceph 2.0 k 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.9 M 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:15.0.0-7936.g827e03c.el7 ceph 1.7 M 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:15.0.0-7936.g827e03c.el7 ceph 4.4 M 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:15.0.0-7936.g827e03c.el7 ceph 16 M 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-11T13:39:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-11T13:39:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-11T13:39:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-11T13:39:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-11T13:39:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-11T13:39:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-11T13:39:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+21 Dependent packages) 2019-12-11T13:39:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:39:57.663 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 28 M 2019-12-11T13:39:57.663 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 87 M 2019-12-11T13:39:57.663 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:39:57.823 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-11T13:39:58.128 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-11T13:39:58.512 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-11T13:39:59.217 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-11T13:39:59.726 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 21/22 2019-12-11T13:39:59.757 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:39:59.757 INFO:teuthology.orchestra.run.smithi073.stdout:Total 13 MB/s | 28 MB 00:02 2019-12-11T13:39:59.782 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:39:59.829 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:39:59.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 22/22 2019-12-11T13:40:00.103 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:00.103 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:00.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-11T13:40:00.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-11T13:40:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-11T13:40:00.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-11T13:40:00.529 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-osd-15.0.0-7936.g827e03c.el7.x86_64 5/22 2019-12-11T13:40:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 6/22 2019-12-11T13:40:00.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 7/22 2019-12-11T13:40:00.888 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 8/22 2019-12-11T13:40:00.915 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-11T13:40:01.022 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-11T13:40:01.122 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-11T13:40:01.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-11T13:40:01.308 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-11T13:40:01.373 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-11T13:40:01.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-12-11T13:40:01.583 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 14/22 2019-12-11T13:40:01.683 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 15/22 2019-12-11T13:40:01.827 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 16/22 2019-12-11T13:40:01.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mds-15.0.0-7936.g827e03c.el7.x86_64 17/22 2019-12-11T13:40:02.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-12-11T13:40:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-11T13:40:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-12-11T13:40:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-12-11T13:40:02.362 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-12-11T13:40:02.563 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mon-15.0.0-7936.g827e03c.el7.x86_64 4/22 2019-12-11T13:40:02.890 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mon-15.0.0-7936.g827e03c.el7.x86_64 22/22 2019-12-11T13:40:02.890 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:02.890 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:02.890 INFO:teuthology.orchestra.run.smithi150.stdout: ceph.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:02.891 INFO:teuthology.orchestra.run.smithi150.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-11T13:40:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-11T13:40:02.893 INFO:teuthology.orchestra.run.smithi150.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-11T13:40:02.894 INFO:teuthology.orchestra.run.smithi150.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-11T13:40:02.894 INFO:teuthology.orchestra.run.smithi150.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-11T13:40:02.894 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:02.894 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:03.006 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-12-11T13:40:03.025 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-daemon 2019-12-11T13:40:03.323 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:03.369 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:03.370 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:03.370 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:03.371 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:03.371 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:03.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-12-11T13:40:04.032 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:04.094 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-12-11T13:40:04.372 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:04.372 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:04.373 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:04.701 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-12-11T13:40:04.739 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-daemon x86_64 2:15.0.0-7936.g827e03c.el7 ceph 17 k 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 17 k 2019-12-11T13:40:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 68 k 2019-12-11T13:40:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mds-15.0.0-7936.g827e03c.el7.x86_64 9/22 2019-12-11T13:40:05.310 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:05.315 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:05.316 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:05.316 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:05.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/22 2019-12-11T13:40:05.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-12-11T13:40:06.072 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-daemon-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-12-11T13:40:06.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-daemon-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:40:06.494 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:06.494 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:06.495 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-daemon.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:06.495 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:06.495 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:06.613 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr 2019-12-11T13:40:06.699 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-12-11T13:40:06.857 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:06.901 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:06.902 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:06.902 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:06.902 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:06.903 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:07.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-11T13:40:07.567 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:07.902 INFO:teuthology.orchestra.run.smithi150.stdout:Package 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:40:07.902 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do 2019-12-11T13:40:07.966 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-dashboard 2019-12-11T13:40:08.217 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:08.264 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:08.265 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:08.266 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:08.266 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:08.266 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:08.929 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:08.999 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-11T13:40:09.275 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:09.275 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:09.275 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:09.278 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:09.309 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:09.310 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:09.311 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:09.311 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-11T13:40:09.311 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-11T13:40:09.312 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:09.312 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-11T13:40:09.373 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-osd-15.0.0-7936.g827e03c.el7.x86_64 16/22 2019-12-11T13:40:09.635 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-11T13:40:09.702 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:09.934 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-11T13:40:09.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:09.935 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 3.9 M 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:09.936 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 18 k 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+3 Dependent packages) 2019-12-11T13:40:09.937 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:09.938 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 4.6 M 2019-12-11T13:40:09.938 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 20 M 2019-12-11T13:40:09.938 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:10.322 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-11T13:40:11.009 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-11T13:40:11.505 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 21/22 2019-12-11T13:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 22/22 2019-12-11T13:40:11.912 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-11T13:40:11.996 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-11T13:40:12.113 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-11T13:40:12.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-11T13:40:12.306 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-osd-15.0.0-7936.g827e03c.el7.x86_64 5/22 2019-12-11T13:40:12.448 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 6/22 2019-12-11T13:40:12.557 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 7/22 2019-12-11T13:40:12.665 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 8/22 2019-12-11T13:40:12.824 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-11T13:40:12.891 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:12.891 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.5 MB/s | 4.6 MB 00:02 2019-12-11T13:40:12.901 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:12.905 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:12.933 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-11T13:40:13.084 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:13.084 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-11T13:40:13.209 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-11T13:40:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-12-11T13:40:13.468 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 14/22 2019-12-11T13:40:13.577 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-15.0.0-7936.g827e03c.el7.x86_64 15/22 2019-12-11T13:40:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 16/22 2019-12-11T13:40:13.715 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7936.g827e03c.el7.noarch 1/4 2019-12-11T13:40:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mds-15.0.0-7936.g827e03c.el7.x86_64 17/22 2019-12-11T13:40:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-12-11T13:40:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-12-11T13:40:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-12-11T13:40:14.204 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-11T13:40:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-12-11T13:40:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mon-15.0.0-7936.g827e03c.el7.x86_64 22/22 2019-12-11T13:40:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:14.767 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: ceph.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-11T13:40:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-11T13:40:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-11T13:40:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-11T13:40:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:14.771 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:14.889 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-daemon 2019-12-11T13:40:15.138 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:15.181 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:15.793 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:15.870 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-11T13:40:16.117 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:16.118 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:16.118 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:16.273 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 4/4 2019-12-11T13:40:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-11T13:40:16.483 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:16.483 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2/4 2019-12-11T13:40:16.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7936.g827e03c.el7.noarch 3/4 2019-12-11T13:40:16.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:16.703 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:16.704 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-daemon x86_64 2:15.0.0-7936.g827e03c.el7 ceph 17 k 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 17 k 2019-12-11T13:40:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 68 k 2019-12-11T13:40:16.706 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:16.996 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:17.001 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-11T13:40:17.001 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:17.001 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-11T13:40:17.002 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:17.003 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:17.003 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:17.004 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:17.005 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:17.129 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-11T13:40:17.401 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:17.446 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:17.447 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:17.448 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:17.448 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:17.448 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:17.901 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-daemon-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:40:18.103 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:18.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-daemon-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:40:18.404 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:18.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:18.405 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-daemon.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:18.405 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:18.405 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:18.444 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:18.444 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:18.444 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:18.521 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2019-12-11T13:40:18.789 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:18.813 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:18.828 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:19.040 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:19.040 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:19.040 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:19.040 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-cloud 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout: noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 82 k 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:19.041 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 82 k 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 411 k 2019-12-11T13:40:19.042 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:19.380 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:19.383 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:19.435 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:19.435 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:19.792 INFO:teuthology.orchestra.run.smithi073.stdout:Package 2:ceph-mgr-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:40:19.792 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do 2019-12-11T13:40:19.852 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2019-12-11T13:40:20.065 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:20.109 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:20.149 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7936.g827e03c.el7.n 1/1 2019-12-11T13:40:20.647 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7936.g827e03c.el7.n 1/1 2019-12-11T13:40:20.647 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:20.648 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:20.648 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:20.648 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:20.648 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:20.771 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-11T13:40:21.025 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:21.070 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:21.071 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:21.071 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:21.071 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:21.072 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7936.g827e03c.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-11T13:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-11T13:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-11T13:40:21.496 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:21.725 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 3.9 M 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:40:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 18 k 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:21.727 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+3 Dependent packages) 2019-12-11T13:40:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:21.728 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 4.6 M 2019-12-11T13:40:21.728 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 20 M 2019-12-11T13:40:21.728 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:21.728 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:22.065 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:22.066 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:22.066 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:22.068 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:22.099 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:22.099 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-11T13:40:22.106 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:22.107 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:22.109 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:22.109 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:22.109 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-11T13:40:22.110 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-11T13:40:22.111 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-11T13:40:22.113 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-11T13:40:22.113 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:22.113 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-11T13:40:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:Total 6.7 MB/s | 4.6 MB 00:00 2019-12-11T13:40:22.400 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:22.406 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:22.477 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:22.562 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:22.562 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:22.702 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:22.703 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 8.6 M 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:22.705 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:40:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 19 M 2019-12-11T13:40:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 104 M 2019-12-11T13:40:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7936.g827e03c.el7.noarch 1/4 2019-12-11T13:40:23.514 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:23.514 INFO:teuthology.orchestra.run.smithi150.stdout:Total 24 MB/s | 19 MB 00:00 2019-12-11T13:40:23.524 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:23.549 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:23.697 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:23.697 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-11T13:40:24.514 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-11T13:40:25.341 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-11T13:40:25.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-11T13:40:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 4/4 2019-12-11T13:40:26.300 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-11T13:40:26.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7936.g827e03c.el7.noarch 2/4 2019-12-11T13:40:26.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7936.g827e03c.el7.noarch 3/4 2019-12-11T13:40:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-11T13:40:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:27.020 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-11T13:40:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-11T13:40:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:27.022 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:27.119 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-11T13:40:27.148 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-11T13:40:27.413 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:27.458 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:27.459 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:27.460 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:27.460 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:27.460 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:28.102 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:28.442 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:28.442 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:28.442 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:28.807 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-11T13:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-cloud 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 82 k 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 82 k 2019-12-11T13:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 411 k 2019-12-11T13:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.n 5/5 2019-12-11T13:40:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-11T13:40:29.386 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:29.390 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.n 2/5 2019-12-11T13:40:29.445 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:29.446 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-11T13:40:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-11T13:40:30.142 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7936.g827e03c.el7.n 1/1 2019-12-11T13:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-11T13:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-11T13:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-11T13:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:30.639 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7936.g827e03c.el7.n 1/1 2019-12-11T13:40:30.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:30.639 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:30.640 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:30.640 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:30.640 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:30.651 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-rook 2019-12-11T13:40:30.767 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-11T13:40:30.920 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:30.945 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:30.967 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:30.968 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:30.969 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:30.969 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:30.969 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:30.983 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:30.983 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:30.984 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:30.984 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:30.984 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:31.593 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:31.622 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:31.917 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:31.917 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:31.918 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:31.920 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:31.950 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:31.950 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-11T13:40:31.957 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:31.957 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:31.960 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-11T13:40:31.960 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:31.960 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-11T13:40:31.961 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-11T13:40:31.962 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-11T13:40:31.963 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-11T13:40:31.964 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:31.964 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-11T13:40:31.970 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:31.970 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:31.970 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:31.972 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:32.003 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:32.003 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-11T13:40:32.005 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:32.006 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:32.007 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:32.008 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:32.009 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:32.009 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-11T13:40:32.009 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-11T13:40:32.010 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-11T13:40:32.010 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:32.011 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:32.012 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:32.013 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-11T13:40:32.013 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-11T13:40:32.014 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:32.014 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-11T13:40:32.015 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-11T13:40:32.015 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-11T13:40:32.015 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-11T13:40:32.016 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-11T13:40:32.016 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:32.016 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-11T13:40:32.324 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:32.381 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:32.546 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:32.546 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:32.546 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout: noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 8.6 M 2019-12-11T13:40:32.547 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:32.548 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:32.549 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:40:32.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:32.549 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 19 M 2019-12-11T13:40:32.549 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 104 M 2019-12-11T13:40:32.550 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:32.611 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:32.611 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:32.613 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 23 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-11T13:40:32.614 INFO:teuthology.orchestra.run.smithi150.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:32.615 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:32.616 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+10 Dependent packages) 2019-12-11T13:40:32.616 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:32.616 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 1.6 M 2019-12-11T13:40:32.617 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 24 M 2019-12-11T13:40:32.617 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:32.929 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:32.930 INFO:teuthology.orchestra.run.smithi150.stdout:Total 5.2 MB/s | 1.6 MB 00:00 2019-12-11T13:40:32.937 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:32.944 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:32.989 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:32.991 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:33.270 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:33.270 INFO:teuthology.orchestra.run.smithi073.stdout:Total 26 MB/s | 19 MB 00:00 2019-12-11T13:40:33.286 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:33.323 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:33.781 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-11T13:40:34.193 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-11T13:40:34.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-11T13:40:34.839 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-11T13:40:34.857 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-11T13:40:35.205 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-11T13:40:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-11T13:40:35.542 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-11T13:40:35.938 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-11T13:40:36.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-11T13:40:37.147 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-11T13:40:37.568 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-11T13:40:37.981 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-11T13:40:38.259 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 11/11 2019-12-11T13:40:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-11T13:40:38.526 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 2/11 2019-12-11T13:40:38.643 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 3/11 2019-12-11T13:40:38.735 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-11T13:40:38.844 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-12-11T13:40:38.845 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-11T13:40:38.961 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-11T13:40:39.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 7/11 2019-12-11T13:40:39.187 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-12-11T13:40:39.263 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-12-11T13:40:39.346 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-12-11T13:40:39.744 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.n 5/5 2019-12-11T13:40:39.774 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-11T13:40:39.774 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:39.774 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:39.774 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:39.774 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-11T13:40:39.775 INFO:teuthology.orchestra.run.smithi150.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-11T13:40:39.893 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-ssh 2019-12-11T13:40:39.941 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7936.g827e03c.el7.n 2/5 2019-12-11T13:40:40.050 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-11T13:40:40.142 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-11T13:40:40.143 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:40.187 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:40.188 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:40.188 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:40.189 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:40.189 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:40.603 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-11T13:40:40.603 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-11T13:40:40.604 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:40.605 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:40.732 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2019-12-11T13:40:40.835 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:40.997 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:41.044 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:41.045 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:41.045 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:41.046 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:41.046 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:41.175 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:41.175 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:41.175 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:41.178 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:41.208 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:41.208 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-11T13:40:41.209 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-11T13:40:41.210 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:41.210 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-11T13:40:41.576 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:41.689 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:41.807 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:41.807 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:41.808 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:41.808 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-ssh noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 33 k 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-11T13:40:41.809 INFO:teuthology.orchestra.run.smithi150.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+2 Dependent packages) 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 316 k 2019-12-11T13:40:41.810 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 1.1 M 2019-12-11T13:40:41.811 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:42.034 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:42.035 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:42.035 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:42.036 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:42.067 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:42.067 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-11T13:40:42.069 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:42.070 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:42.071 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:42.072 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-11T13:40:42.073 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:42.073 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-11T13:40:42.074 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-11T13:40:42.074 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-11T13:40:42.074 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:42.075 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:42.076 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-11T13:40:42.077 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-11T13:40:42.077 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-11T13:40:42.078 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:42.078 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-11T13:40:42.078 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-11T13:40:42.079 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-11T13:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-11T13:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-11T13:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-11T13:40:42.114 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:42.115 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.0 MB/s | 316 kB 00:00 2019-12-11T13:40:42.118 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:42.126 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:42.200 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:42.204 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:42.443 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:42.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:42.671 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:42.673 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:42.673 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:42.673 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:40:42.673 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:42.674 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:42.674 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 23 k 2019-12-11T13:40:42.675 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-11T13:40:42.676 INFO:teuthology.orchestra.run.smithi073.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:42.677 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+10 Dependent packages) 2019-12-11T13:40:42.678 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:42.678 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.6 M 2019-12-11T13:40:42.678 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 24 M 2019-12-11T13:40:42.678 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:43.043 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-11T13:40:43.106 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:43.107 INFO:teuthology.orchestra.run.smithi073.stdout:Total 3.8 MB/s | 1.6 MB 00:00 2019-12-11T13:40:43.121 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:43.134 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:43.360 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-11T13:40:43.658 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 3/3 2019-12-11T13:40:43.745 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-11T13:40:43.871 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-11T13:40:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 3/3 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:44.289 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:44.290 INFO:teuthology.orchestra.run.smithi150.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-11T13:40:44.290 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:44.290 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:44.417 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-fuse 2019-12-11T13:40:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-11T13:40:44.640 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:44.684 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:44.685 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:44.685 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:44.686 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:44.686 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-11T13:40:45.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-11T13:40:45.341 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:45.626 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-11T13:40:45.683 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:45.683 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:45.683 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:45.690 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:40:45.723 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:40:45.723 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:45.724 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-11T13:40:45.724 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:45.725 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:45.726 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:45.727 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:45.728 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:45.728 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-11T13:40:45.734 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-11T13:40:45.735 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-11T13:40:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-11T13:40:46.100 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:46.325 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:46.326 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:46.326 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:46.327 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 566 k 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:46.328 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 10 M 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 49 M 2019-12-11T13:40:46.329 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:46.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-11T13:40:46.712 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-11T13:40:46.727 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:46.727 INFO:teuthology.orchestra.run.smithi150.stdout:Total 25 MB/s | 10 MB 00:00 2019-12-11T13:40:46.740 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:46.759 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:46.897 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:46.897 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:48.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-11T13:40:48.469 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-11T13:40:48.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 11/11 2019-12-11T13:40:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-11T13:40:48.981 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7936.g827e03c.el7.noarch 2/11 2019-12-11T13:40:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 3/11 2019-12-11T13:40:49.137 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-11T13:40:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-11T13:40:49.333 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-12-11T13:40:49.433 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-11T13:40:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 7/11 2019-12-11T13:40:49.676 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-12-11T13:40:49.703 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-11T13:40:49.785 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-12-11T13:40:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-12-11T13:40:50.463 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-11T13:40:50.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:50.463 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-11T13:40:50.464 INFO:teuthology.orchestra.run.smithi073.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-11T13:40:50.465 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:50.466 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:50.587 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-ssh 2019-12-11T13:40:50.823 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-11T13:40:50.845 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:50.890 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:50.891 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:50.892 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:50.892 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:50.893 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-11T13:40:51.531 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:51.643 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 5/5 2019-12-11T13:40:51.758 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/5 2019-12-11T13:40:51.867 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-11T13:40:51.868 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:51.869 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:51.869 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:51.872 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 2019-12-11T13:40:51.902 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:51.902 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-11T13:40:51.902 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-11T13:40:51.903 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:51.903 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-11T13:40:52.001 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-11T13:40:52.109 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-11T13:40:52.266 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:52.491 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:52.492 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:40:52.492 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:52.492 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-ssh noarch 2:15.0.0-7936.g827e03c.el7 ceph-noarch 33 k 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:52.493 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:52.494 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+2 Dependent packages) 2019-12-11T13:40:52.494 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:52.494 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 316 k 2019-12-11T13:40:52.494 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.1 M 2019-12-11T13:40:52.494 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-11T13:40:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:52.595 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:52.596 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-11T13:40:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-11T13:40:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:52.596 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:52.723 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs2 2019-12-11T13:40:52.755 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:52.755 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 316 kB 00:00 2019-12-11T13:40:52.757 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:52.763 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:52.854 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:52.856 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:52.966 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:53.011 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:53.011 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:53.012 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:53.012 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:53.012 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:53.672 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:53.698 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-11T13:40:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-11T13:40:54.008 INFO:teuthology.orchestra.run.smithi150.stdout:Package 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:40:54.008 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do 2019-12-11T13:40:54.070 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs-devel 2019-12-11T13:40:54.247 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:54.283 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:54.284 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:54.284 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:54.285 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:54.285 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:54.380 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 3/3 2019-12-11T13:40:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-11T13:40:54.653 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-11T13:40:54.876 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:55.111 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7936.g827e03c.el7.noarch 3/3 2019-12-11T13:40:55.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:55.112 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:40:55.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:55.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:55.112 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:40:55.113 INFO:teuthology.orchestra.run.smithi073.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-11T13:40:55.113 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:55.113 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:40:55.206 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:40:55.206 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7936.g827e03c.el7 for package: 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:40:55.238 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:40:55.238 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package librados-devel.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:55.239 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2019-12-11T13:40:55.494 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:55.539 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:40:55.610 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:55.839 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:55.840 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:55.841 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:15.0.0-7936.g827e03c.el7 ceph 17 k 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout:Installing for dependencies: 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:15.0.0-7936.g827e03c.el7 ceph 153 k 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:40:55.842 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:40:55.843 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package (+1 Dependent package) 2019-12-11T13:40:55.843 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:55.843 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 170 k 2019-12-11T13:40:55.843 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 679 k 2019-12-11T13:40:55.843 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:40:56.196 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:56.234 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:56.234 INFO:teuthology.orchestra.run.smithi150.stdout:Total 432 kB/s | 170 kB 00:00 2019-12-11T13:40:56.236 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:40:56.243 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:40:56.245 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:40:56.245 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:40:56.533 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:40:56.533 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:56.533 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:40:56.544 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:40:56.576 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:40:56.577 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:56.577 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-11T13:40:56.577 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:56.579 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:56.580 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:56.581 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-11T13:40:56.581 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:40:56.581 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-11T13:40:56.587 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-11T13:40:56.587 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-11T13:40:56.814 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:librados-devel-15.0.0-7936.g827e03c.el7.x86_64 1/2 2019-12-11T13:40:56.949 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:40:57.093 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 2/2 2019-12-11T13:40:57.170 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:57.171 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:40:57.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:57.171 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:57.171 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 566 k 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:40:57.172 INFO:teuthology.orchestra.run.smithi073.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+4 Dependent packages) 2019-12-11T13:40:57.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:40:57.174 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 10 M 2019-12-11T13:40:57.174 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 49 M 2019-12-11T13:40:57.174 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:40:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 1/2 2019-12-11T13:40:57.521 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:40:57.521 INFO:teuthology.orchestra.run.smithi073.stdout:Total 29 MB/s | 10 MB 00:00 2019-12-11T13:40:57.530 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:40:57.544 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:40:57.622 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:40:57.623 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:40:57.716 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:librados-devel-15.0.0-7936.g827e03c.el7.x86_64 2/2 2019-12-11T13:40:57.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:57.717 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:40:57.717 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:57.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:57.718 INFO:teuthology.orchestra.run.smithi150.stdout:Dependency Installed: 2019-12-11T13:40:57.718 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:40:57.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:40:57.719 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:40:57.845 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install librados2 2019-12-11T13:40:58.100 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:58.145 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:58.146 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:58.146 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:58.146 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:58.147 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:58.809 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:40:59.147 INFO:teuthology.orchestra.run.smithi150.stdout:Package 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:40:59.148 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do 2019-12-11T13:40:59.210 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install librbd1 2019-12-11T13:40:59.373 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:40:59.408 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:40:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:40:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:40:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:40:59.410 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:40:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-11T13:41:00.011 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:00.339 INFO:teuthology.orchestra.run.smithi150.stdout:Package 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:41:00.340 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do 2019-12-11T13:41:00.407 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install python-ceph 2019-12-11T13:41:00.495 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-11T13:41:00.631 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:00.673 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:00.674 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:00.674 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:00.675 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:00.675 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:41:01.336 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:01.427 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-11T13:41:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:41:01.669 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:41:01.669 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-11T13:41:02.040 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:41:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 5/5 2019-12-11T13:41:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:02.226 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:41:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:02.227 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Size 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-compat x86_64 2:15.0.0-7936.g827e03c.el7 ceph 2.2 k 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:02.228 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 2.2 k 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 0 2019-12-11T13:41:02.229 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:41:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:ceph-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/5 2019-12-11T13:41:02.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-11T13:41:02.488 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:41:02.489 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:41:02.490 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:41:02.490 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:41:02.540 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-11T13:41:02.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-11T13:41:02.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:python-ceph-compat-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:03.167 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-11T13:41:03.167 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-11T13:41:03.168 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-11T13:41:03.169 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:03.169 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:41:03.297 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2019-12-11T13:41:03.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:python-ceph-compat-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:03.497 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:03.497 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:41:03.497 INFO:teuthology.orchestra.run.smithi150.stdout: python-ceph-compat.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:03.497 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:03.497 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:41:03.576 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:03.608 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-fuse 2019-12-11T13:41:03.623 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:03.624 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:03.625 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:03.625 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:03.625 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:03.834 INFO:teuthology.orchestra.run.smithi150.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:03.874 INFO:teuthology.orchestra.run.smithi150.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:03.875 INFO:teuthology.orchestra.run.smithi150.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: * updates: mirror.vtti.vt.edu 2019-12-11T13:41:04.272 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:04.533 INFO:teuthology.orchestra.run.smithi150.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:04.617 INFO:teuthology.orchestra.run.smithi073.stdout:Package 2:libcephfs2-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:41:04.617 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do 2019-12-11T13:41:04.678 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2019-12-11T13:41:04.862 INFO:teuthology.orchestra.run.smithi150.stdout:Resolving Dependencies 2019-12-11T13:41:04.862 INFO:teuthology.orchestra.run.smithi150.stdout:--> Running transaction check 2019-12-11T13:41:04.862 INFO:teuthology.orchestra.run.smithi150.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:04.892 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:04.936 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:04.937 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:04.938 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:04.938 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:04.938 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:05.238 INFO:teuthology.orchestra.run.smithi150.stdout:--> Finished Dependency Resolution 2019-12-11T13:41:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:05.425 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies Resolved 2019-12-11T13:41:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:05.426 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2019-12-11T13:41:05.426 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:05.426 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 76 k 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:05.427 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 76 k 2019-12-11T13:41:05.428 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 200 k 2019-12-11T13:41:05.428 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading packages: 2019-12-11T13:41:05.590 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:05.722 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2019-12-11T13:41:05.744 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2019-12-11T13:41:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded 2019-12-11T13:41:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2019-12-11T13:41:05.923 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:41:05.924 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:41:05.924 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:05.924 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7936.g827e03c.el7 for package: 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 2019-12-11T13:41:05.954 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:41:05.955 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package librados-devel.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:41:06.408 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : 2:rbd-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:06.547 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:06.548 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:41:06.548 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:41:06.549 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:15.0.0-7936.g827e03c.el7 ceph 17 k 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:15.0.0-7936.g827e03c.el7 ceph 153 k 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package (+1 Dependent package) 2019-12-11T13:41:06.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:06.551 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 170 k 2019-12-11T13:41:06.551 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 679 k 2019-12-11T13:41:06.551 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:41:06.859 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : 2:rbd-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:06.859 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:06.859 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2019-12-11T13:41:06.859 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:06.860 INFO:teuthology.orchestra.run.smithi150.stdout: 2019-12-11T13:41:06.860 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2019-12-11T13:41:06.910 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:41:06.910 INFO:teuthology.orchestra.run.smithi073.stdout:Total 470 kB/s | 170 kB 00:00 2019-12-11T13:41:06.913 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:41:06.925 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:41:06.928 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:41:06.928 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:41:06.984 DEBUG:teuthology.parallel:result is None 2019-12-11T13:41:07.488 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:librados-devel-15.0.0-7936.g827e03c.el7.x86_64 1/2 2019-12-11T13:41:07.758 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 2/2 2019-12-11T13:41:07.889 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:libcephfs-devel-15.0.0-7936.g827e03c.el7.x86_64 1/2 2019-12-11T13:41:08.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:librados-devel-15.0.0-7936.g827e03c.el7.x86_64 2/2 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:08.358 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:41:08.476 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2019-12-11T13:41:08.696 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:08.739 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:08.740 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:08.741 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:08.741 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:08.741 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:09.388 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:09.724 INFO:teuthology.orchestra.run.smithi073.stdout:Package 2:librados2-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:41:09.725 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do 2019-12-11T13:41:09.784 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2019-12-11T13:41:10.004 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:10.045 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:10.046 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:10.047 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:10.047 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:10.048 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:10.688 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:11.024 INFO:teuthology.orchestra.run.smithi073.stdout:Package 2:librbd1-15.0.0-7936.g827e03c.el7.x86_64 already installed and latest version 2019-12-11T13:41:11.024 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do 2019-12-11T13:41:11.080 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install python-ceph 2019-12-11T13:41:11.241 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:11.275 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:11.276 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:11.277 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:11.277 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:11.277 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:11.857 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:12.181 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:41:12.181 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:41:12.182 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:12.549 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:41:12.739 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:12.739 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:41:12.740 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:12.740 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:12.740 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout: Size 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-compat x86_64 2:15.0.0-7936.g827e03c.el7 ceph 2.2 k 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:41:12.741 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:12.742 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T13:41:12.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:12.742 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 k 2019-12-11T13:41:12.742 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 0 2019-12-11T13:41:12.742 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:41:13.042 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:41:13.044 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:41:13.046 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:41:13.046 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:41:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:python-ceph-compat-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:python-ceph-compat-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:14.087 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:41:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: python-ceph-compat.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:14.087 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:41:14.189 INFO:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2019-12-11T13:41:14.455 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:41:14.502 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:41:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:41:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:41:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:41:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:41:15.160 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:41:15.505 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:41:15.505 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:41:15.505 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 will be installed 2019-12-11T13:41:15.879 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:41:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:41:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:15.0.0-7936.g827e03c.el7 ceph 76 k 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:16.067 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 76 k 2019-12-11T13:41:16.068 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 200 k 2019-12-11T13:41:16.068 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:41:16.415 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:41:16.435 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:41:16.436 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:41:16.437 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:41:17.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : 2:rbd-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:17.633 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : 2:rbd-fuse-15.0.0-7936.g827e03c.el7.x86_64 1/1 2019-12-11T13:41:17.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:17.634 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:41:17.634 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse.x86_64 2:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:17.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:41:17.634 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:41:17.748 DEBUG:teuthology.parallel:result is None 2019-12-11T13:41:17.749 INFO:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2019-12-11T13:41:17.884 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS 2019-12-11T13:41:17.886 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:41:17.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:41:18.035 INFO:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-11T13:41:18.171 INFO:teuthology.orchestra.run.smithi073.stdout:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:18.172 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7936.g827e03c.el7 2019-12-11T13:41:18.172 INFO:teuthology.task.install:The correct ceph version 15.0.0-7936.g827e03c is installed. 2019-12-11T13:41:18.172 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2019-12-11T13:41:18.321 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2019-12-11T13:41:18.322 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-11T13:41:18.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:41:18.485 INFO:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-11T13:41:18.610 INFO:teuthology.orchestra.run.smithi150.stdout:15.0.0-7936.g827e03c.el7 2019-12-11T13:41:18.610 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7936.g827e03c.el7 2019-12-11T13:41:18.610 INFO:teuthology.task.install:The correct ceph version 15.0.0-7936.g827e03c is installed. 2019-12-11T13:41:18.610 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-11T13:41:18.611 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-11T13:41:18.728 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-11T13:41:18.846 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-11T13:41:18.846 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-11T13:41:18.966 INFO:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-11T13:41:19.074 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-11T13:41:19.196 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-11T13:41:19.307 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-11T13:41:19.307 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-11T13:41:19.424 INFO:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-11T13:41:19.523 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-11T13:41:19.639 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-11T13:41:19.734 INFO:teuthology.run_tasks:Running task ceph... 2019-12-11T13:41:19.823 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-11T13:41:19.824 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2019-12-11T13:41:19.828 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2019-12-11T13:41:19.944 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-11T13:41:19.944 INFO:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-11T13:41:19.948 INFO:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-11T13:41:20.056 INFO:tasks.ceph:Creating extra log directories... 2019-12-11T13:41:20.056 INFO:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-11T13:41:20.060 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-11T13:41:20.168 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-11T13:41:20.168 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-12-11T13:41:20.169 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'public-access-qa', 'git_remote': 'git://github.com/theanalyst/'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2491', 'owner': 'scheduled_abhi@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi073.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+kCjYzStMcZG5+0HmKr26w9M8yIoMd3nbjCB4TFRPHHtWbJtWFFwWREtycm+ZQ9kt8gXPAZrI1ygLX9Zf775GLi5QAZddZavc1MJC2B/WNO/lR684Yw36L67TM/khtICvbdztyVGuhhcmIsCfVTEoj2OLVEUpoc4qXkwVFXglqSkSsqVaFrkD12MI1E1VT0IsN90Rfwy/iYbOTlmI3nHQ3HlpKBlARip+U+uodi4dNPF0Ji7k2o9KUAfL01a42eImfm5B8XWy9T1Z+WqZFIvHXxIlnVpGENnRsJdyqUKsMmKNxubr9EnQlsTyGJLaPbKSK0slvS+JubIIsyiw+Crd', 'smithi150.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwd/pYxGspvqS0N5DyDJa0xx2YV1AE40TgasnczDGz55cc9RIyvC4mVpimyUGIzMxp9P8k4FiTJyOZxie3oxYVKAaVm2b9gQ7pwLL2EQDLaDugvI7motMDKQjRprR5Py0Zwb8KdVcBFQo80xmPuQ3TLgjDiy6s1Z/A+mdVcatEaNL3fx3LFnq/sUS54dtnwNRCMwokXLjIImfA0R/pkPrrzfeK56KQ2lVFW7Zmbfl981aRyuQG3fvGy2vchtbvlR5IQuLmmNgouKqhZ7X1HMzZFzK63TGy1qFhcSx8w4n9NYWBP5MT7vc/GwRKu6HtMFhm4wvgyvQ7ZRBwt1slMmHR'}, 'job_id': '4585200', 'tube': 'smithi', 'suite_branch': 'wip-abhi-testing-2019-12-04-1433', 'priority': 99, 'first_in_suite': False, 'branch': 'wip-abhi-testing-2019-12-04-1433', 'suite': 'rgw', 'email': None, 'archive_path': '/home/teuthworker/archive/abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi/4585200', 'description': 'rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b', 'name': 'abhi-2019-12-09_15:07:12-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b', 'os_type': 'centos', 'overrides': {'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b'}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': False}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'admin_socket': {'branch': 'wip-abhi-testing-2019-12-04-1433'}, 'workunit': {'sha1': '827e03c8a6b1e17d93dcaf79724437bac291c35b', 'branch': 'wip-abhi-testing-2019-12-04-1433'}}} 2019-12-11T13:41:20.169 INFO:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-11T13:41:20.173 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-11T13:41:20.255 INFO:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2019-12-11T13:41:20.259 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2019-12-11T13:41:20.455 DEBUG:teuthology.orchestra.remote:smithi073:/scratch_devs is 72B 2019-12-11T13:41:20.534 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-11T13:41:20.534 INFO:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-11T13:41:20.612 INFO:teuthology.orchestra.run.smithi073.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-11T13:41:20.612 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:20.612 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 105929 Links: 1 2019-12-11T13:41:20.612 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:20.612 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:20.613 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2019-12-11 13:40:11.354238775 +0000 2019-12-11T13:41:20.613 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2019-12-11 13:38:02.120097268 +0000 2019-12-11T13:41:20.613 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2019-12-11 13:38:02.120097268 +0000 2019-12-11T13:41:20.613 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2019-12-11T13:41:20.641 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2019-12-11T13:41:20.642 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2019-12-11T13:41:20.642 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes (512 B) copied, 0.000437521 s, 1.2 MB/s 2019-12-11T13:41:20.647 INFO:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-11T13:41:20.772 INFO:teuthology.orchestra.run.smithi073.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 109180 Links: 1 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2019-12-11 13:40:11.354238775 +0000 2019-12-11T13:41:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2019-12-11 13:38:02.607082307 +0000 2019-12-11T13:41:20.774 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2019-12-11 13:38:02.607082307 +0000 2019-12-11T13:41:20.774 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2019-12-11T13:41:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2019-12-11T13:41:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2019-12-11T13:41:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes (512 B) copied, 0.000431458 s, 1.2 MB/s 2019-12-11T13:41:20.805 INFO:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-11T13:41:20.878 INFO:teuthology.orchestra.run.smithi073.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-11T13:41:20.878 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 105980 Links: 1 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2019-12-11 13:40:11.354238775 +0000 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2019-12-11 13:38:03.112066793 +0000 2019-12-11T13:41:20.879 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2019-12-11 13:38:03.112066793 +0000 2019-12-11T13:41:20.880 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2019-12-11T13:41:20.907 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2019-12-11T13:41:20.907 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2019-12-11T13:41:20.907 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes (512 B) copied, 0.000341262 s, 1.5 MB/s 2019-12-11T13:41:20.912 INFO:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-11T13:41:20.972 INFO:teuthology.orchestra.run.smithi073.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 102810 Links: 1 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2019-12-11 13:40:11.354238775 +0000 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2019-12-11 13:38:03.607051586 +0000 2019-12-11T13:41:20.973 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2019-12-11 13:38:03.607051586 +0000 2019-12-11T13:41:20.975 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2019-12-11T13:41:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2019-12-11T13:41:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2019-12-11T13:41:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes (512 B) copied, 0.000324326 s, 1.6 MB/s 2019-12-11T13:41:20.997 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-11T13:41:20.998 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-11T13:41:20.998 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-11T13:41:20.998 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:21.090 DEBUG:teuthology.orchestra.remote:smithi150:/scratch_devs is 72B 2019-12-11T13:41:21.164 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-11T13:41:21.165 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-11T13:41:21.240 INFO:teuthology.orchestra.run.smithi150.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-11T13:41:21.240 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:21.240 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 107319 Links: 1 2019-12-11T13:41:21.240 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:21.241 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:21.241 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2019-12-11 13:39:59.596585841 +0000 2019-12-11T13:41:21.241 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2019-12-11 13:38:02.119043531 +0000 2019-12-11T13:41:21.241 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2019-12-11 13:38:02.119043531 +0000 2019-12-11T13:41:21.241 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2019-12-11T13:41:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2019-12-11T13:41:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2019-12-11T13:41:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes (512 B) copied, 0.000424603 s, 1.2 MB/s 2019-12-11T13:41:21.272 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-11T13:41:21.400 INFO:teuthology.orchestra.run.smithi150.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 101898 Links: 1 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2019-12-11 13:39:59.596585841 +0000 2019-12-11T13:41:21.401 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2019-12-11 13:38:02.589041058 +0000 2019-12-11T13:41:21.402 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2019-12-11 13:38:02.589041058 +0000 2019-12-11T13:41:21.402 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2019-12-11T13:41:21.428 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2019-12-11T13:41:21.428 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2019-12-11T13:41:21.429 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes (512 B) copied, 0.000448704 s, 1.1 MB/s 2019-12-11T13:41:21.433 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-11T13:41:21.508 INFO:teuthology.orchestra.run.smithi150.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 110624 Links: 1 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2019-12-11 13:39:59.596585841 +0000 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2019-12-11 13:38:03.096038390 +0000 2019-12-11T13:41:21.509 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2019-12-11 13:38:03.096038390 +0000 2019-12-11T13:41:21.510 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2019-12-11T13:41:21.535 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2019-12-11T13:41:21.535 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2019-12-11T13:41:21.536 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes (512 B) copied, 0.000446596 s, 1.1 MB/s 2019-12-11T13:41:21.539 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-11T13:41:21.602 INFO:teuthology.orchestra.run.smithi150.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-11T13:41:21.603 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-11T13:41:21.603 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 110655 Links: 1 2019-12-11T13:41:21.603 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-11T13:41:21.603 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2019-12-11T13:41:21.603 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2019-12-11 13:39:59.596585841 +0000 2019-12-11T13:41:21.604 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2019-12-11 13:38:03.579035848 +0000 2019-12-11T13:41:21.604 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2019-12-11 13:38:03.579035848 +0000 2019-12-11T13:41:21.604 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2019-12-11T13:41:21.630 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2019-12-11T13:41:21.630 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2019-12-11T13:41:21.631 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes (512 B) copied, 0.000305429 s, 1.7 MB/s 2019-12-11T13:41:21.635 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-11T13:41:21.635 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-11T13:41:21.635 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-11T13:41:21.636 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:21.636 INFO:tasks.ceph:Generating config... 2019-12-11T13:41:21.637 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-12-11T13:41:21.637 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-11T13:41:21.637 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-12-11T13:41:21.637 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-11T13:41:21.637 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-12-11T13:41:21.638 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-12-11T13:41:21.639 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-12-11T13:41:21.639 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-12-11T13:41:21.639 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-12-11T13:41:21.639 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] bdev async discard = True 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-12-11T13:41:21.640 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-11T13:41:21.641 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-12-11T13:41:21.641 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-12-11T13:41:21.641 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-11T13:41:21.641 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-11T13:41:21.641 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-12-11T13:41:21.642 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-11T13:41:21.642 INFO:tasks.ceph:[client] debug rgw = 20 2019-12-11T13:41:21.642 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-12-11T13:41:21.642 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-12-11T13:41:21.642 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-12-11T13:41:21.642 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-12-11T13:41:21.642 INFO:tasks.ceph:Setting up mon.a... 2019-12-11T13:41:21.643 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-11T13:41:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2019-12-11T13:41:21.809 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-11T13:41:21.958 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-11T13:41:22.073 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.b', '172.21.15.150')] 2019-12-11T13:41:22.074 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --add b 172.21.15.150 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 311d9c34-7a5d-47a6-9e86-949c71387f05 2019-12-11T13:41:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2019-12-11T13:41:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 311d9c34-7a5d-47a6-9e86-949c71387f05 2019-12-11T13:41:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2019-12-11T13:41:22.229048+0000 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:created 2019-12-11T13:41:22.229048+0000 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 0 (unknown) 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2019-12-11T13:41:22.210 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-12-11T13:41:22.211 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 311d9c34-7a5d-47a6-9e86-949c71387f05... 2019-12-11T13:41:22.213 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-11T13:41:22.216 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-11T13:41:22.441 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-11T13:41:22.441 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-11T13:41:22.613 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-11T13:41:22.706 DEBUG:teuthology.orchestra.remote:smithi073:/etc/ceph/ceph.keyring is 206B 2019-12-11T13:41:22.853 DEBUG:teuthology.orchestra.remote:smithi073:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-12-11T13:41:22.918 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:41:22.918 INFO:teuthology.orchestra.run.smithi073:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-11T13:41:23.012 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:23.061 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:41:23.061 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-11T13:41:23.209 INFO:teuthology.orchestra.run.smithi150:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:23.287 INFO:tasks.ceph:Setting up mon nodes... 2019-12-11T13:41:23.287 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-11T13:41:23.287 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-12-11T13:41:23.462 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-12-11T13:41:23.467 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-11T13:41:23.673 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-11T13:41:23.678 INFO:tasks.ceph:Setting up mds nodes... 2019-12-11T13:41:23.678 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-11T13:41:23.678 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-11T13:41:23.815 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-11T13:41:23.850 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-11T13:41:23.999 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-11T13:41:24.035 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-11T13:41:24.035 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-12-11T13:41:24.036 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-11T13:41:24.151 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:24.151 INFO:tasks.ceph:{} 2019-12-11T13:41:24.151 INFO:tasks.ceph:osd.0 2019-12-11T13:41:24.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:41:24.152 INFO:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-11T13:41:24.721 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:24.722 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:24.723 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:24.723 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:24.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2019-12-11T13:41:24.726 INFO:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-11T13:41:24.894 INFO:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-11T13:41:24.992 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-11T13:41:25.070 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:25.070 INFO:tasks.ceph:{} 2019-12-11T13:41:25.070 INFO:tasks.ceph:osd.1 2019-12-11T13:41:25.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:41:25.071 INFO:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-11T13:41:25.591 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:25.591 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:25.591 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:25.591 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:25.592 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:25.592 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:25.592 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:25.592 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:25.592 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:25.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2019-12-11T13:41:25.593 INFO:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-11T13:41:25.726 INFO:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-11T13:41:25.817 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-11T13:41:25.896 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:25.896 INFO:tasks.ceph:{} 2019-12-11T13:41:25.897 INFO:tasks.ceph:osd.2 2019-12-11T13:41:25.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:41:25.897 INFO:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-11T13:41:26.454 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:26.455 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:26.455 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:26.455 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:26.455 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:26.456 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:26.456 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:26.456 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:26.456 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:26.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2019-12-11T13:41:26.458 INFO:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-11T13:41:26.637 INFO:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-11T13:41:26.749 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-12-11T13:41:26.859 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:26.860 INFO:tasks.ceph:{} 2019-12-11T13:41:26.860 INFO:tasks.ceph:osd.3 2019-12-11T13:41:26.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:41:26.861 INFO:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:27.415 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:27.416 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:27.416 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:27.416 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:27.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2019-12-11T13:41:27.417 INFO:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-12-11T13:41:27.515 INFO:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-12-11T13:41:27.588 INFO:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.698+0000 7f09f0bd1b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-11T13:41:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.698+0000 7f09f0bd1b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-11T13:41:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.698+0000 7f09f0bd1b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-11T13:41:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.698+0000 7f09f0bd1b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-11T13:41:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.699+0000 7f09f0bd1b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-11T13:41:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:27.699+0000 7f09f0bd1b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-12-11T13:41:29.989 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-11T13:41:30.097 INFO:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.245+0000 7fab22679b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-11T13:41:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.245+0000 7fab22679b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-11T13:41:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.245+0000 7fab22679b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-11T13:41:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.246+0000 7fab22679b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-11T13:41:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.246+0000 7fab22679b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-11T13:41:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:30.247+0000 7fab22679b40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-12-11T13:41:32.537 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-11T13:41:32.656 INFO:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:32.803 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.823+0000 7fa5e244db40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-11T13:41:32.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.824+0000 7fa5e244db40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-11T13:41:32.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.824+0000 7fa5e244db40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-11T13:41:32.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.824+0000 7fa5e244db40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-11T13:41:32.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.824+0000 7fa5e244db40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-11T13:41:32.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:32.825+0000 7fa5e244db40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-12-11T13:41:35.111 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-11T13:41:35.227 INFO:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:35.382 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.403+0000 7f9253bbeb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-12-11T13:41:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.404+0000 7f9253bbeb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-12-11T13:41:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.404+0000 7f9253bbeb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-11T13:41:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.404+0000 7f9253bbeb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-11T13:41:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.404+0000 7f9253bbeb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-11T13:41:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:41:35.405+0000 7f9253bbeb40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-12-11T13:41:37.693 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-12-11T13:41:37.807 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-12-11T13:41:37.924 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:37.924 INFO:tasks.ceph:{} 2019-12-11T13:41:37.924 INFO:tasks.ceph:osd.4 2019-12-11T13:41:37.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:41:37.925 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-11T13:41:38.507 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:38.508 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:38.508 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:38.508 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:38.509 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:38.509 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:38.509 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:38.509 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:38.509 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:38.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2019-12-11T13:41:38.511 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-12-11T13:41:38.683 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-12-11T13:41:38.799 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-12-11T13:41:38.903 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:38.904 INFO:tasks.ceph:{} 2019-12-11T13:41:38.904 INFO:tasks.ceph:osd.5 2019-12-11T13:41:38.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:41:38.904 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-11T13:41:39.460 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:39.460 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:39.460 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:39.460 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:39.460 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:39.461 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:39.461 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:39.461 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:39.461 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:39.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2019-12-11T13:41:39.463 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-12-11T13:41:39.616 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-12-11T13:41:39.724 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-12-11T13:41:39.815 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:39.816 INFO:tasks.ceph:{} 2019-12-11T13:41:39.816 INFO:tasks.ceph:osd.6 2019-12-11T13:41:39.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:41:39.816 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-11T13:41:40.408 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:40.409 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:40.410 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:40.410 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:40.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2019-12-11T13:41:40.411 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-12-11T13:41:40.568 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-12-11T13:41:40.643 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-12-11T13:41:40.706 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-11T13:41:40.707 INFO:tasks.ceph:{} 2019-12-11T13:41:40.707 INFO:tasks.ceph:osd.7 2019-12-11T13:41:40.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:41:40.707 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-11T13:41:41.242 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-11T13:41:41.242 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-11T13:41:41.243 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=0, sparse=0 2019-12-11T13:41:41.243 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-11T13:41:41.243 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2019-12-11T13:41:41.243 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-11T13:41:41.244 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-11T13:41:41.244 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-11T13:41:41.244 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-11T13:41:41.246 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2019-12-11T13:41:41.246 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-12-11T13:41:41.364 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-12-11T13:41:41.467 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:41.592 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.594+0000 7efd913cab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-12-11T13:41:41.593 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.595+0000 7efd913cab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-12-11T13:41:41.593 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.595+0000 7efd913cab40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-11T13:41:41.594 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.595+0000 7efd913cab40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-11T13:41:41.594 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.595+0000 7efd913cab40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-11T13:41:41.594 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:41.596+0000 7efd913cab40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-12-11T13:41:43.904 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-12-11T13:41:44.022 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:44.170 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.172+0000 7f0ba3409b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-12-11T13:41:44.171 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.173+0000 7f0ba3409b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-12-11T13:41:44.171 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.173+0000 7f0ba3409b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-11T13:41:44.171 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.173+0000 7f0ba3409b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-11T13:41:44.171 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.173+0000 7f0ba3409b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-11T13:41:44.172 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:44.174+0000 7f0ba3409b40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-12-11T13:41:46.477 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-12-11T13:41:46.593 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:46.741 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.743+0000 7f50c1084b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-12-11T13:41:46.742 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.744+0000 7f50c1084b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-12-11T13:41:46.742 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.744+0000 7f50c1084b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-11T13:41:46.742 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.744+0000 7f50c1084b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-11T13:41:46.743 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.744+0000 7f50c1084b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-11T13:41:46.743 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:46.745+0000 7f50c1084b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-12-11T13:41:49.051 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-12-11T13:41:49.169 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:49.313 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.315+0000 7f63694b8b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-12-11T13:41:49.314 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.316+0000 7f63694b8b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-12-11T13:41:49.314 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.316+0000 7f63694b8b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-11T13:41:49.315 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.316+0000 7f63694b8b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-11T13:41:49.315 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.316+0000 7f63694b8b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-11T13:41:49.315 INFO:teuthology.orchestra.run.smithi150.stderr:2019-12-11T13:41:49.318+0000 7f63694b8b40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-12-11T13:41:51.626 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-12-11T13:41:51.742 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-11T13:41:51.742 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:41:51.832 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.CUIShLfK6G 2019-12-11T13:41:51.832 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.CUIShLfK6G 2019-12-11T13:41:51.932 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.CUIShLfK6G 2019-12-11T13:41:52.118 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.CUIShLfK6G is 56B 2019-12-11T13:41:52.188 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.CUIShLfK6G 2019-12-11T13:41:52.254 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:41:52.382 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.EhhAWLO8Fh 2019-12-11T13:41:52.382 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.EhhAWLO8Fh 2019-12-11T13:41:52.481 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.EhhAWLO8Fh 2019-12-11T13:41:52.659 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.EhhAWLO8Fh is 56B 2019-12-11T13:41:52.738 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.EhhAWLO8Fh 2019-12-11T13:41:52.803 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:41:52.861 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.XwZkRM5R17 2019-12-11T13:41:52.862 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.XwZkRM5R17 2019-12-11T13:41:52.944 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.XwZkRM5R17 2019-12-11T13:41:53.064 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.XwZkRM5R17 is 56B 2019-12-11T13:41:53.125 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.XwZkRM5R17 2019-12-11T13:41:53.173 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:41:53.228 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.UM0i9IUwa7 2019-12-11T13:41:53.229 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.UM0i9IUwa7 2019-12-11T13:41:53.293 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.UM0i9IUwa7 2019-12-11T13:41:53.402 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.UM0i9IUwa7 is 56B 2019-12-11T13:41:53.454 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.UM0i9IUwa7 2019-12-11T13:41:53.502 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:41:53.613 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ahiRGP0Qth 2019-12-11T13:41:53.613 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.ahiRGP0Qth 2019-12-11T13:41:53.716 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ahiRGP0Qth 2019-12-11T13:41:53.913 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ahiRGP0Qth is 56B 2019-12-11T13:41:53.988 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ahiRGP0Qth 2019-12-11T13:41:54.051 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:41:54.144 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.DJdxAqLNUe 2019-12-11T13:41:54.144 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.DJdxAqLNUe 2019-12-11T13:41:54.252 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.DJdxAqLNUe 2019-12-11T13:41:54.447 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.DJdxAqLNUe is 56B 2019-12-11T13:41:54.523 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.DJdxAqLNUe 2019-12-11T13:41:54.586 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:41:54.643 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.fQ2VxkwB6f 2019-12-11T13:41:54.643 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.fQ2VxkwB6f 2019-12-11T13:41:54.713 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.fQ2VxkwB6f 2019-12-11T13:41:54.828 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.fQ2VxkwB6f is 56B 2019-12-11T13:41:54.880 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.fQ2VxkwB6f 2019-12-11T13:41:54.927 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:41:55.044 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.gSa0VFNkZY 2019-12-11T13:41:55.044 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.gSa0VFNkZY 2019-12-11T13:41:55.132 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.gSa0VFNkZY 2019-12-11T13:41:55.265 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.gSa0VFNkZY is 56B 2019-12-11T13:41:55.321 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.gSa0VFNkZY 2019-12-11T13:41:55.372 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:41:55.478 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.wCEyNCypha 2019-12-11T13:41:55.478 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.wCEyNCypha 2019-12-11T13:41:55.566 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.wCEyNCypha 2019-12-11T13:41:55.709 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.wCEyNCypha is 56B 2019-12-11T13:41:55.762 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.wCEyNCypha 2019-12-11T13:41:55.812 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:41:55.857 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.BAqjFrOkKu 2019-12-11T13:41:55.858 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.BAqjFrOkKu 2019-12-11T13:41:55.980 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.BAqjFrOkKu 2019-12-11T13:41:56.119 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.BAqjFrOkKu is 56B 2019-12-11T13:41:56.174 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.BAqjFrOkKu 2019-12-11T13:41:56.319 DEBUG:teuthology.orchestra.remote:smithi073:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-11T13:41:56.475 DEBUG:teuthology.orchestra.remote:smithi150:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-11T13:41:56.545 INFO:tasks.ceph:Adding keys to all mons... 2019-12-11T13:41:56.546 INFO:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-11T13:41:56.549 INFO:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-11T13:41:56.633 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2019-12-11T13:41:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAD8vBdT+LNHBAA5t9m2slOJ3tb0nCTxMLAQg== 2019-12-11T13:41:56.633 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2019-12-11T13:41:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAH8vBdLbm8KRAAwPimoVxNHdiyHLW0j3Fz4g== 2019-12-11T13:41:56.633 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2019-12-11T13:41:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAK8vBdPCisDhAACwmrfOgerdodNmtV0MCFwQ== 2019-12-11T13:41:56.634 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2019-12-11T13:41:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAM8vBdUBgqMRAASZs+m7h1T6t7J9U3wlw9Cw== 2019-12-11T13:41:56.634 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2019-12-11T13:41:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAP8vBdfsoeGBAAcB5eH+XOpFNEQs/JqN1Tzw== 2019-12-11T13:41:56.635 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2019-12-11T13:41:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAD8vBdprlKKBAAt4Kx6IzB67I4vRNJxq9Ffw== 2019-12-11T13:41:56.635 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2019-12-11T13:41:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAV8vBdzH6BIxAA6Mysa2Hejzf238GmUJMsOw== 2019-12-11T13:41:56.635 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAY8vBdocZUChAAh+b4hOny5d9VbYgxfsawbA== 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAa8vBdnBphLBAAsjX1l+okM1APwu5jRyIhQQ== 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAd8vBdrh7iEhAAfYcjr+/IZ0WaHlMdoVNWwQ== 2019-12-11T13:41:56.636 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2019-12-11T13:41:56.637 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAD8vBdYyvYMRAArqrEZz83rPdj0Zr724J2LQ== 2019-12-11T13:41:56.637 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2019-12-11T13:41:56.637 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAE8vBdvIMcABAAFL7VPCub6Rz/rNfeHuiUFA== 2019-12-11T13:41:56.650 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2019-12-11T13:41:56.650 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAD8vBdT+LNHBAA5t9m2slOJ3tb0nCTxMLAQg== 2019-12-11T13:41:56.651 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2019-12-11T13:41:56.651 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAH8vBdLbm8KRAAwPimoVxNHdiyHLW0j3Fz4g== 2019-12-11T13:41:56.651 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2019-12-11T13:41:56.651 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAK8vBdPCisDhAACwmrfOgerdodNmtV0MCFwQ== 2019-12-11T13:41:56.651 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAM8vBdUBgqMRAASZs+m7h1T6t7J9U3wlw9Cw== 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAP8vBdfsoeGBAAcB5eH+XOpFNEQs/JqN1Tzw== 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAD8vBdprlKKBAAt4Kx6IzB67I4vRNJxq9Ffw== 2019-12-11T13:41:56.652 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2019-12-11T13:41:56.653 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAV8vBdzH6BIxAA6Mysa2Hejzf238GmUJMsOw== 2019-12-11T13:41:56.653 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2019-12-11T13:41:56.653 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAY8vBdocZUChAAh+b4hOny5d9VbYgxfsawbA== 2019-12-11T13:41:56.653 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2019-12-11T13:41:56.653 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAa8vBdnBphLBAAsjX1l+okM1APwu5jRyIhQQ== 2019-12-11T13:41:56.654 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2019-12-11T13:41:56.654 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAd8vBdrh7iEhAAfYcjr+/IZ0WaHlMdoVNWwQ== 2019-12-11T13:41:56.654 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2019-12-11T13:41:56.654 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAD8vBdYyvYMRAArqrEZz83rPdj0Zr724J2LQ== 2019-12-11T13:41:56.654 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2019-12-11T13:41:56.655 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAE8vBdvIMcABAAFL7VPCub6Rz/rNfeHuiUFA== 2019-12-11T13:41:56.656 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-11T13:41:56.660 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-11T13:41:56.838 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:56.842 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.009 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.012 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.175 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.179 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.350 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.354 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.522 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-11T13:41:57.532 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-11T13:41:57.698 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.702 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.869 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:57.872 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:58.034 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:58.037 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:58.201 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:58.205 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-11T13:41:58.361 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-11T13:41:58.365 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-11T13:41:58.543 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-11T13:41:58.547 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-11T13:41:58.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-11T13:41:58.707 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-11T13:41:58.798 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-11T13:41:58.910 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-11T13:41:58.985 INFO:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-12-11T13:41:59.050 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-11T13:41:59.142 INFO:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-12-11T13:41:59.199 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-12-11T13:41:59.319 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-11T13:41:59.463 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-12-11T13:41:59.539 INFO:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:59.542 INFO:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-11T13:41:59.616 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-11T13:41:59.616 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-11T13:41:59.616 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-11T13:41:59.617 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-12-11T13:41:59.620 INFO:tasks.ceph.mon.a:Started 2019-12-11T13:41:59.620 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-11T13:41:59.620 INFO:tasks.ceph.mon.c:Restarting daemon 2019-12-11T13:41:59.620 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-12-11T13:41:59.623 INFO:tasks.ceph.mon.c:Started 2019-12-11T13:41:59.623 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-11T13:41:59.624 INFO:tasks.ceph.mon.b:Restarting daemon 2019-12-11T13:41:59.624 INFO:teuthology.orchestra.run.smithi150:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-12-11T13:41:59.627 INFO:tasks.ceph.mon.b:Started 2019-12-11T13:41:59.628 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-11T13:41:59.628 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-12-11T13:41:59.628 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-12-11T13:41:59.631 INFO:tasks.ceph.mgr.y:Started 2019-12-11T13:41:59.631 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-11T13:41:59.631 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-12-11T13:41:59.634 INFO:tasks.ceph.mgr.x:Started 2019-12-11T13:41:59.634 INFO:tasks.ceph:Setting crush tunables to default 2019-12-11T13:41:59.635 INFO:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2019-12-11T13:42:03.739 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:00:03.921 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:42:03.852 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:00:03.995 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:42:03.891 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:00:04.034 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:42:16.305 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2019-12-11T13:42:16.318 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-11T13:42:16.318 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:42:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.P4hXc2szGH 2019-12-11T13:42:16.365 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.P4hXc2szGH 2019-12-11T13:42:16.423 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.P4hXc2szGH 2019-12-11T13:42:16.524 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.P4hXc2szGH is 37B 2019-12-11T13:42:16.581 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.P4hXc2szGH 2019-12-11T13:42:16.622 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:42:16.715 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ozaebBHHX1 2019-12-11T13:42:16.715 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ozaebBHHX1 2019-12-11T13:42:16.781 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ozaebBHHX1 2019-12-11T13:42:16.884 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ozaebBHHX1 is 37B 2019-12-11T13:42:16.930 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ozaebBHHX1 2019-12-11T13:42:16.971 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:42:17.050 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.GzmRs4HnNI 2019-12-11T13:42:17.050 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.GzmRs4HnNI 2019-12-11T13:42:17.143 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.GzmRs4HnNI 2019-12-11T13:42:17.245 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.GzmRs4HnNI is 37B 2019-12-11T13:42:17.291 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.GzmRs4HnNI 2019-12-11T13:42:17.331 INFO:teuthology.orchestra.run.smithi073:> mktemp 2019-12-11T13:42:17.426 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.AqlGcS1Sy7 2019-12-11T13:42:17.426 INFO:teuthology.orchestra.run.smithi073:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.AqlGcS1Sy7 2019-12-11T13:42:17.482 INFO:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.AqlGcS1Sy7 2019-12-11T13:42:17.578 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.AqlGcS1Sy7 is 37B 2019-12-11T13:42:17.625 INFO:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.AqlGcS1Sy7 2019-12-11T13:42:17.666 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:42:17.759 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.WImQJ19xFj 2019-12-11T13:42:17.760 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.WImQJ19xFj 2019-12-11T13:42:17.846 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.WImQJ19xFj 2019-12-11T13:42:17.989 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.WImQJ19xFj is 37B 2019-12-11T13:42:18.049 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.WImQJ19xFj 2019-12-11T13:42:18.101 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:42:18.198 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.f6KrxEEtN6 2019-12-11T13:42:18.199 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.f6KrxEEtN6 2019-12-11T13:42:18.261 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.f6KrxEEtN6 2019-12-11T13:42:18.364 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.f6KrxEEtN6 is 37B 2019-12-11T13:42:18.412 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.f6KrxEEtN6 2019-12-11T13:42:18.457 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:42:18.558 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.LrbsPd53bX 2019-12-11T13:42:18.558 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.LrbsPd53bX 2019-12-11T13:42:18.631 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.LrbsPd53bX 2019-12-11T13:42:18.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.LrbsPd53bX is 37B 2019-12-11T13:42:18.787 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.LrbsPd53bX 2019-12-11T13:42:18.829 INFO:teuthology.orchestra.run.smithi150:> mktemp 2019-12-11T13:42:18.932 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.1sTRKJJOZZ 2019-12-11T13:42:18.932 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.1sTRKJJOZZ 2019-12-11T13:42:19.012 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.1sTRKJJOZZ 2019-12-11T13:42:19.135 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.1sTRKJJOZZ is 37B 2019-12-11T13:42:19.189 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.1sTRKJJOZZ 2019-12-11T13:42:19.251 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new de7fb345-97e8-471f-83ae-90bcb5eaa7bf 0 2019-12-11T13:42:20.469 INFO:teuthology.orchestra.run.smithi150.stdout:0 2019-12-11T13:42:20.491 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 7a0bf5ae-cafd-4917-9d58-9b54ebd523a3 1 2019-12-11T13:42:21.817 INFO:teuthology.orchestra.run.smithi150.stdout:1 2019-12-11T13:42:21.844 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 9ad3daff-0fc8-42be-85fd-f8562ca4edbd 2 2019-12-11T13:42:23.037 INFO:teuthology.orchestra.run.smithi150.stdout:2 2019-12-11T13:42:23.073 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 71f751d2-0710-45fa-a123-7110f9677e70 3 2019-12-11T13:42:24.130 INFO:teuthology.orchestra.run.smithi150.stdout:3 2019-12-11T13:42:24.151 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new dd6650d1-98c9-45b8-9c44-9b2d800893ba 4 2019-12-11T13:42:25.418 INFO:teuthology.orchestra.run.smithi150.stdout:4 2019-12-11T13:42:25.443 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 83f6abc6-2f40-4eb3-9974-76b37affe377 5 2019-12-11T13:42:26.507 INFO:teuthology.orchestra.run.smithi150.stdout:5 2019-12-11T13:42:26.529 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 801cbaef-0d42-4cad-8b67-792e5b6e8a6f 6 2019-12-11T13:42:27.563 INFO:teuthology.orchestra.run.smithi150.stdout:6 2019-12-11T13:42:27.585 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 52bbe6c7-f98c-4858-8efd-5b1f261996f5 7 2019-12-11T13:42:28.638 INFO:teuthology.orchestra.run.smithi150.stdout:7 2019-12-11T13:42:28.662 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.662 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-11T13:42:28.662 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-12-11T13:42:28.666 INFO:tasks.ceph.osd.0:Started 2019-12-11T13:42:28.666 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.666 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-11T13:42:28.666 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-12-11T13:42:28.670 INFO:tasks.ceph.osd.1:Started 2019-12-11T13:42:28.670 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.671 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-11T13:42:28.672 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-12-11T13:42:28.675 INFO:tasks.ceph.osd.2:Started 2019-12-11T13:42:28.676 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.676 INFO:tasks.ceph.osd.3:Restarting daemon 2019-12-11T13:42:28.677 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-12-11T13:42:28.680 INFO:tasks.ceph.osd.3:Started 2019-12-11T13:42:28.680 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.681 INFO:tasks.ceph.osd.4:Restarting daemon 2019-12-11T13:42:28.681 INFO:teuthology.orchestra.run.smithi150:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-12-11T13:42:28.685 INFO:tasks.ceph.osd.4:Started 2019-12-11T13:42:28.685 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.685 INFO:tasks.ceph.osd.5:Restarting daemon 2019-12-11T13:42:28.685 INFO:teuthology.orchestra.run.smithi150:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-12-11T13:42:28.691 INFO:tasks.ceph.osd.5:Started 2019-12-11T13:42:28.691 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.691 INFO:tasks.ceph.osd.6:Restarting daemon 2019-12-11T13:42:28.691 INFO:teuthology.orchestra.run.smithi150:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-12-11T13:42:28.695 INFO:tasks.ceph.osd.6:Started 2019-12-11T13:42:28.695 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-11T13:42:28.695 INFO:tasks.ceph.osd.7:Restarting daemon 2019-12-11T13:42:28.696 INFO:teuthology.orchestra.run.smithi150:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-12-11T13:42:28.699 INFO:tasks.ceph.osd.7:Started 2019-12-11T13:42:28.699 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-11T13:42:29.509 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:30.218 INFO:teuthology.misc.health.smithi073.stdout: 2019-12-11T13:42:30.218 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:28.525496+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:30.232 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-11T13:42:32.456 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:03.636 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.466 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:03.655 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.489 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:03.681 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.512 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:03.691 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.512 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:03.693 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.533 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:03.722 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.556 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:03.749 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.567 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:03.747 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.603 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:03.789 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.659 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:03.876 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.660 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:03.846 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:32.720 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:03.937 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.132 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T13:42:33.112+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.150 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T13:42:33.131+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.172 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T13:42:33.155+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.178 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T13:42:33.169+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.198 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T13:42:33.198+0000 114ae700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6819/0: (98) Address already in use 2019-12-11T13:42:33.208 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T13:42:33.220+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.295 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T13:42:33.307+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:33.330 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:04.511 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.373 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:04.562 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.415 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:04.600 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.465 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:04.645 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.477 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:04.658 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.520 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:04.699 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.530 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:04.723 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.542 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:04.760 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.593 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:04.782 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.646 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:04.843 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.671 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:04.863 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.726 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:04.919 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.785 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:04.975 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.798 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:04.988 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.815 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:05.001 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.840 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:05.026 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.873 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:05.065 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.884 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:05.077 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.919 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:05.098 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.937 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:05.116 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.957 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:05.174 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:33.981 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:05.197 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T13:42:34.280+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:34.348 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T13:42:34.355+0000 9b13800 -1 Falling back to public interface 2019-12-11T13:42:34.506 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:05.703 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.577 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:05.769 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.678 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:05.870 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.689 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:05.882 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.850 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:06.047 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:34.861 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:06.058 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:36.731 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:07.912 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:36.742 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:07.923 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.012 INFO:tasks.ceph.osd.7.smithi150.stderr:==00:00:00:08.193 10187== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.038 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:37.231 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:08.411 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.244 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:08.424 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.262 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:08.448 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.266 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:08.452 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.329 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:08.522 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.343 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:08.531 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.486 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:08.703 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.494 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:08.711 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.507 INFO:tasks.ceph.osd.4.smithi150.stderr:==00:00:00:08.686 10188== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.531 INFO:tasks.ceph.osd.2.smithi073.stderr:==00:00:00:08.717 10521== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.571 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:08.760 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.575 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:08.765 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.610 INFO:tasks.ceph.osd.6.smithi150.stderr:==00:00:00:08.802 10185== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.758 INFO:tasks.ceph.osd.3.smithi073.stderr:==00:00:00:08.975 10512== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:37.800 INFO:teuthology.misc.health.smithi073.stdout: 2019-12-11T13:42:37.800 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:28.525496+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:37.813 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-11T13:42:37.835 INFO:tasks.ceph.osd.5.smithi150.stderr:==00:00:00:09.024 10186== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.107 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:09.303 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.117 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:09.313 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.378 INFO:tasks.ceph.osd.1.smithi073.stderr:==00:00:00:09.575 10519== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.527 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:09.720 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.536 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:09.729 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.740 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T13:42:38.739+0000 9b13800 -1 osd.7 0 log_to_monitors {default=true} 2019-12-11T13:42:38.795 INFO:tasks.ceph.osd.0.smithi073.stderr:==00:00:00:09.988 10520== Warning: unimplemented fcntl command: 1038 2019-12-11T13:42:38.905 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T13:42:38.903+0000 9b13800 -1 osd.4 0 log_to_monitors {default=true} 2019-12-11T13:42:39.007 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T13:42:38.998+0000 9b13800 -1 osd.6 0 log_to_monitors {default=true} 2019-12-11T13:42:39.017 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T13:42:39.039+0000 9b13800 -1 osd.2 0 log_to_monitors {default=true} 2019-12-11T13:42:39.242 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T13:42:39.264+0000 9b13800 -1 osd.3 0 log_to_monitors {default=true} 2019-12-11T13:42:39.332 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T13:42:39.332+0000 9b13800 -1 osd.5 0 log_to_monitors {default=true} 2019-12-11T13:42:39.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T13:42:39.854+0000 9b13800 -1 osd.1 0 log_to_monitors {default=true} 2019-12-11T13:42:40.170 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T13:42:40.191+0000 9b13800 -1 osd.0 0 log_to_monitors {default=true} 2019-12-11T13:42:41.142 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T13:42:41.164+0000 2476e700 -1 osd.3 0 waiting for initial osdmap 2019-12-11T13:42:41.179 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T13:42:41.199+0000 27772700 -1 osd.2 0 waiting for initial osdmap 2019-12-11T13:42:41.239 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T13:42:41.237+0000 27772700 -1 osd.6 0 waiting for initial osdmap 2019-12-11T13:42:41.316 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T13:42:41.292+0000 27772700 -1 osd.4 0 waiting for initial osdmap 2019-12-11T13:42:41.317 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T13:42:41.311+0000 27772700 -1 osd.7 0 waiting for initial osdmap 2019-12-11T13:42:42.347 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T13:42:42.346+0000 27b72700 -1 osd.5 0 waiting for initial osdmap 2019-12-11T13:42:42.366 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T13:42:42.387+0000 2476e700 -1 osd.0 0 waiting for initial osdmap 2019-12-11T13:42:42.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T13:42:42.494+0000 2476e700 -1 osd.1 0 waiting for initial osdmap 2019-12-11T13:42:44.622 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:45.590 INFO:teuthology.misc.health.smithi073.stdout: 2019-12-11T13:42:45.590 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":16,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:45.293002+0000","last_up_change":"2019-12-11T13:42:43.986144+0000","last_in_change":"2019-12-11T13:42:43.986144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":10520},{"type":"v1","addr":"172.21.15.73:6827","nonce":10520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":10520},{"type":"v1","addr":"172.21.15.73:6829","nonce":10520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":10520},{"type":"v1","addr":"172.21.15.73:6833","nonce":10520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":10520},{"type":"v1","addr":"172.21.15.73:6831","nonce":10520}]},"public_addr":"172.21.15.73:6827/10520","cluster_addr":"172.21.15.73:6829/10520","heartbeat_back_addr":"172.21.15.73:6833/10520","heartbeat_front_addr":"172.21.15.73:6831/10520","state":["exists","up"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":10519},{"type":"v1","addr":"172.21.15.73:6819","nonce":10519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":10519},{"type":"v1","addr":"172.21.15.73:6821","nonce":10519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":10519},{"type":"v1","addr":"172.21.15.73:6825","nonce":10519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":10519},{"type":"v1","addr":"172.21.15.73:6823","nonce":10519}]},"public_addr":"172.21.15.73:6819/10519","cluster_addr":"172.21.15.73:6821/10519","heartbeat_back_addr":"172.21.15.73:6825/10519","heartbeat_front_addr":"172.21.15.73:6823/10519","state":["exists","up"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":10521},{"type":"v1","addr":"172.21.15.73:6803","nonce":10521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":10521},{"type":"v1","addr":"172.21.15.73:6805","nonce":10521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":10521},{"type":"v1","addr":"172.21.15.73:6809","nonce":10521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":10521},{"type":"v1","addr":"172.21.15.73:6807","nonce":10521}]},"public_addr":"172.21.15.73:6803/10521","cluster_addr":"172.21.15.73:6805/10521","heartbeat_back_addr":"172.21.15.73:6809/10521","heartbeat_front_addr":"172.21.15.73:6807/10521","state":["exists","up"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":10512},{"type":"v1","addr":"172.21.15.73:6811","nonce":10512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":10512},{"type":"v1","addr":"172.21.15.73:6813","nonce":10512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":10512},{"type":"v1","addr":"172.21.15.73:6817","nonce":10512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":10512},{"type":"v1","addr":"172.21.15.73:6815","nonce":10512}]},"public_addr":"172.21.15.73:6811/10512","cluster_addr":"172.21.15.73:6813/10512","heartbeat_back_addr":"172.21.15.73:6817/10512","heartbeat_front_addr":"172.21.15.73:6815/10512","state":["exists","up"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":10188},{"type":"v1","addr":"172.21.15.150:6819","nonce":10188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":10188},{"type":"v1","addr":"172.21.15.150:6823","nonce":10188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":10188},{"type":"v1","addr":"172.21.15.150:6830","nonce":10188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":10188},{"type":"v1","addr":"172.21.15.150:6826","nonce":10188}]},"public_addr":"172.21.15.150:6819/10188","cluster_addr":"172.21.15.150:6823/10188","heartbeat_back_addr":"172.21.15.150:6830/10188","heartbeat_front_addr":"172.21.15.150:6826/10188","state":["exists","up"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":10186},{"type":"v1","addr":"172.21.15.150:6809","nonce":10186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":10186},{"type":"v1","addr":"172.21.15.150:6811","nonce":10186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":10186},{"type":"v1","addr":"172.21.15.150:6817","nonce":10186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":10186},{"type":"v1","addr":"172.21.15.150:6814","nonce":10186}]},"public_addr":"172.21.15.150:6809/10186","cluster_addr":"172.21.15.150:6811/10186","heartbeat_back_addr":"172.21.15.150:6817/10186","heartbeat_front_addr":"172.21.15.150:6814/10186","state":["exists","up"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":10185},{"type":"v1","addr":"172.21.15.150:6815","nonce":10185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":10185},{"type":"v1","addr":"172.21.15.150:6822","nonce":10185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6829","nonce":10185},{"type":"v1","addr":"172.21.15.150:6831","nonce":10185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":10185},{"type":"v1","addr":"172.21.15.150:6827","nonce":10185}]},"public_addr":"172.21.15.150:6815/10185","cluster_addr":"172.21.15.150:6822/10185","heartbeat_back_addr":"172.21.15.150:6831/10185","heartbeat_front_addr":"172.21.15.150:6827/10185","state":["exists","up"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":10187},{"type":"v1","addr":"172.21.15.150:6801","nonce":10187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":10187},{"type":"v1","addr":"172.21.15.150:6803","nonce":10187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":10187},{"type":"v1","addr":"172.21.15.150:6808","nonce":10187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":10187},{"type":"v1","addr":"172.21.15.150:6805","nonce":10187}]},"public_addr":"172.21.15.150:6801/10187","cluster_addr":"172.21.15.150:6803/10187","heartbeat_back_addr":"172.21.15.150:6808/10187","heartbeat_front_addr":"172.21.15.150:6805/10187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:41.319643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.957596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.149306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.314749+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.042325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.511291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.088113+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:39.876144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:45.603 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-12-11T13:42:45.603 INFO:tasks.ceph:Creating RBD pool 2019-12-11T13:42:45.604 INFO:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-11T13:42:47.025 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2019-12-11T13:42:47.042 INFO:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-11T13:42:49.089 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-11T13:42:49.105 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-11T13:42:49.106 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:49.106 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-11T13:42:49.840 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:42:49.840 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:48.936579+0000","last_up_change":"2019-12-11T13:42:43.986144+0000","last_in_change":"2019-12-11T13:42:43.986144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-11T13:42:46.267315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":10520},{"type":"v1","addr":"172.21.15.73:6827","nonce":10520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":10520},{"type":"v1","addr":"172.21.15.73:6829","nonce":10520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":10520},{"type":"v1","addr":"172.21.15.73:6833","nonce":10520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":10520},{"type":"v1","addr":"172.21.15.73:6831","nonce":10520}]},"public_addr":"172.21.15.73:6827/10520","cluster_addr":"172.21.15.73:6829/10520","heartbeat_back_addr":"172.21.15.73:6833/10520","heartbeat_front_addr":"172.21.15.73:6831/10520","state":["exists","up"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":10519},{"type":"v1","addr":"172.21.15.73:6819","nonce":10519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":10519},{"type":"v1","addr":"172.21.15.73:6821","nonce":10519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":10519},{"type":"v1","addr":"172.21.15.73:6825","nonce":10519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":10519},{"type":"v1","addr":"172.21.15.73:6823","nonce":10519}]},"public_addr":"172.21.15.73:6819/10519","cluster_addr":"172.21.15.73:6821/10519","heartbeat_back_addr":"172.21.15.73:6825/10519","heartbeat_front_addr":"172.21.15.73:6823/10519","state":["exists","up"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":10521},{"type":"v1","addr":"172.21.15.73:6803","nonce":10521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":10521},{"type":"v1","addr":"172.21.15.73:6805","nonce":10521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":10521},{"type":"v1","addr":"172.21.15.73:6809","nonce":10521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":10521},{"type":"v1","addr":"172.21.15.73:6807","nonce":10521}]},"public_addr":"172.21.15.73:6803/10521","cluster_addr":"172.21.15.73:6805/10521","heartbeat_back_addr":"172.21.15.73:6809/10521","heartbeat_front_addr":"172.21.15.73:6807/10521","state":["exists","up"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":10512},{"type":"v1","addr":"172.21.15.73:6811","nonce":10512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":10512},{"type":"v1","addr":"172.21.15.73:6813","nonce":10512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":10512},{"type":"v1","addr":"172.21.15.73:6817","nonce":10512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":10512},{"type":"v1","addr":"172.21.15.73:6815","nonce":10512}]},"public_addr":"172.21.15.73:6811/10512","cluster_addr":"172.21.15.73:6813/10512","heartbeat_back_addr":"172.21.15.73:6817/10512","heartbeat_front_addr":"172.21.15.73:6815/10512","state":["exists","up"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":10188},{"type":"v1","addr":"172.21.15.150:6819","nonce":10188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":10188},{"type":"v1","addr":"172.21.15.150:6823","nonce":10188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":10188},{"type":"v1","addr":"172.21.15.150:6830","nonce":10188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":10188},{"type":"v1","addr":"172.21.15.150:6826","nonce":10188}]},"public_addr":"172.21.15.150:6819/10188","cluster_addr":"172.21.15.150:6823/10188","heartbeat_back_addr":"172.21.15.150:6830/10188","heartbeat_front_addr":"172.21.15.150:6826/10188","state":["exists","up"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":10186},{"type":"v1","addr":"172.21.15.150:6809","nonce":10186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":10186},{"type":"v1","addr":"172.21.15.150:6811","nonce":10186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":10186},{"type":"v1","addr":"172.21.15.150:6817","nonce":10186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":10186},{"type":"v1","addr":"172.21.15.150:6814","nonce":10186}]},"public_addr":"172.21.15.150:6809/10186","cluster_addr":"172.21.15.150:6811/10186","heartbeat_back_addr":"172.21.15.150:6817/10186","heartbeat_front_addr":"172.21.15.150:6814/10186","state":["exists","up"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":10185},{"type":"v1","addr":"172.21.15.150:6815","nonce":10185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":10185},{"type":"v1","addr":"172.21.15.150:6822","nonce":10185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6829","nonce":10185},{"type":"v1","addr":"172.21.15.150:6831","nonce":10185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":10185},{"type":"v1","addr":"172.21.15.150:6827","nonce":10185}]},"public_addr":"172.21.15.150:6815/10185","cluster_addr":"172.21.15.150:6822/10185","heartbeat_back_addr":"172.21.15.150:6831/10185","heartbeat_front_addr":"172.21.15.150:6827/10185","state":["exists","up"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":10187},{"type":"v1","addr":"172.21.15.150:6801","nonce":10187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":10187},{"type":"v1","addr":"172.21.15.150:6803","nonce":10187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":10187},{"type":"v1","addr":"172.21.15.150:6808","nonce":10187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":10187},{"type":"v1","addr":"172.21.15.150:6805","nonce":10187}]},"public_addr":"172.21.15.150:6801/10187","cluster_addr":"172.21.15.150:6803/10187","heartbeat_back_addr":"172.21.15.150:6808/10187","heartbeat_front_addr":"172.21.15.150:6805/10187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:41.319643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.957596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.149306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.314749+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.042325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.511291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.088113+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:39.876144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:49.855 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-11T13:42:46.267315+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-11T13:42:49.856 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-11T13:42:50.752 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2019-12-11T13:42:50.766 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-11T13:42:50.766 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-11T13:42:50.766 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-11T13:42:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:42:51.841 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":9547},{"type":"v1","addr":"172.21.15.73:6801","nonce":9547}]},"active_addr":"172.21.15.73:6801/9547","active_change":"2019-12-11T13:42:17.156538+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-12-11T13:42:51.850 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-11T13:42:51.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-11T13:42:51.850 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:52.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:42:52.696 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:50.177967+0000","last_up_change":"2019-12-11T13:42:43.986144+0000","last_in_change":"2019-12-11T13:42:43.986144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-11T13:42:46.267315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":10520},{"type":"v1","addr":"172.21.15.73:6827","nonce":10520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":10520},{"type":"v1","addr":"172.21.15.73:6829","nonce":10520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":10520},{"type":"v1","addr":"172.21.15.73:6833","nonce":10520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":10520},{"type":"v1","addr":"172.21.15.73:6831","nonce":10520}]},"public_addr":"172.21.15.73:6827/10520","cluster_addr":"172.21.15.73:6829/10520","heartbeat_back_addr":"172.21.15.73:6833/10520","heartbeat_front_addr":"172.21.15.73:6831/10520","state":["exists","up"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":10519},{"type":"v1","addr":"172.21.15.73:6819","nonce":10519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":10519},{"type":"v1","addr":"172.21.15.73:6821","nonce":10519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":10519},{"type":"v1","addr":"172.21.15.73:6825","nonce":10519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":10519},{"type":"v1","addr":"172.21.15.73:6823","nonce":10519}]},"public_addr":"172.21.15.73:6819/10519","cluster_addr":"172.21.15.73:6821/10519","heartbeat_back_addr":"172.21.15.73:6825/10519","heartbeat_front_addr":"172.21.15.73:6823/10519","state":["exists","up"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":10521},{"type":"v1","addr":"172.21.15.73:6803","nonce":10521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":10521},{"type":"v1","addr":"172.21.15.73:6805","nonce":10521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":10521},{"type":"v1","addr":"172.21.15.73:6809","nonce":10521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":10521},{"type":"v1","addr":"172.21.15.73:6807","nonce":10521}]},"public_addr":"172.21.15.73:6803/10521","cluster_addr":"172.21.15.73:6805/10521","heartbeat_back_addr":"172.21.15.73:6809/10521","heartbeat_front_addr":"172.21.15.73:6807/10521","state":["exists","up"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":10512},{"type":"v1","addr":"172.21.15.73:6811","nonce":10512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":10512},{"type":"v1","addr":"172.21.15.73:6813","nonce":10512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":10512},{"type":"v1","addr":"172.21.15.73:6817","nonce":10512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":10512},{"type":"v1","addr":"172.21.15.73:6815","nonce":10512}]},"public_addr":"172.21.15.73:6811/10512","cluster_addr":"172.21.15.73:6813/10512","heartbeat_back_addr":"172.21.15.73:6817/10512","heartbeat_front_addr":"172.21.15.73:6815/10512","state":["exists","up"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":10188},{"type":"v1","addr":"172.21.15.150:6819","nonce":10188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":10188},{"type":"v1","addr":"172.21.15.150:6823","nonce":10188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":10188},{"type":"v1","addr":"172.21.15.150:6830","nonce":10188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":10188},{"type":"v1","addr":"172.21.15.150:6826","nonce":10188}]},"public_addr":"172.21.15.150:6819/10188","cluster_addr":"172.21.15.150:6823/10188","heartbeat_back_addr":"172.21.15.150:6830/10188","heartbeat_front_addr":"172.21.15.150:6826/10188","state":["exists","up"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":10186},{"type":"v1","addr":"172.21.15.150:6809","nonce":10186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":10186},{"type":"v1","addr":"172.21.15.150:6811","nonce":10186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":10186},{"type":"v1","addr":"172.21.15.150:6817","nonce":10186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":10186},{"type":"v1","addr":"172.21.15.150:6814","nonce":10186}]},"public_addr":"172.21.15.150:6809/10186","cluster_addr":"172.21.15.150:6811/10186","heartbeat_back_addr":"172.21.15.150:6817/10186","heartbeat_front_addr":"172.21.15.150:6814/10186","state":["exists","up"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":10185},{"type":"v1","addr":"172.21.15.150:6815","nonce":10185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":10185},{"type":"v1","addr":"172.21.15.150:6822","nonce":10185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6829","nonce":10185},{"type":"v1","addr":"172.21.15.150:6831","nonce":10185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":10185},{"type":"v1","addr":"172.21.15.150:6827","nonce":10185}]},"public_addr":"172.21.15.150:6815/10185","cluster_addr":"172.21.15.150:6822/10185","heartbeat_back_addr":"172.21.15.150:6831/10185","heartbeat_front_addr":"172.21.15.150:6827/10185","state":["exists","up"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":10187},{"type":"v1","addr":"172.21.15.150:6801","nonce":10187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":10187},{"type":"v1","addr":"172.21.15.150:6803","nonce":10187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":10187},{"type":"v1","addr":"172.21.15.150:6808","nonce":10187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":10187},{"type":"v1","addr":"172.21.15.150:6805","nonce":10187}]},"public_addr":"172.21.15.150:6801/10187","cluster_addr":"172.21.15.150:6803/10187","heartbeat_back_addr":"172.21.15.150:6808/10187","heartbeat_front_addr":"172.21.15.150:6805/10187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:41.319643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.957596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.149306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.314749+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.042325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.511291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.088113+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:39.876144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:52.722 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-11T13:42:52.722 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-11T13:42:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:42:53.448 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"311d9c34-7a5d-47a6-9e86-949c71387f05","created":"2019-12-11T13:42:13.326230+0000","modified":"2019-12-11T13:42:50.177967+0000","last_up_change":"2019-12-11T13:42:43.986144+0000","last_in_change":"2019-12-11T13:42:43.986144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-11T13:42:46.267315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"de7fb345-97e8-471f-83ae-90bcb5eaa7bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":10520},{"type":"v1","addr":"172.21.15.73:6827","nonce":10520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":10520},{"type":"v1","addr":"172.21.15.73:6829","nonce":10520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":10520},{"type":"v1","addr":"172.21.15.73:6833","nonce":10520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":10520},{"type":"v1","addr":"172.21.15.73:6831","nonce":10520}]},"public_addr":"172.21.15.73:6827/10520","cluster_addr":"172.21.15.73:6829/10520","heartbeat_back_addr":"172.21.15.73:6833/10520","heartbeat_front_addr":"172.21.15.73:6831/10520","state":["exists","up"]},{"osd":1,"uuid":"7a0bf5ae-cafd-4917-9d58-9b54ebd523a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":10519},{"type":"v1","addr":"172.21.15.73:6819","nonce":10519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":10519},{"type":"v1","addr":"172.21.15.73:6821","nonce":10519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":10519},{"type":"v1","addr":"172.21.15.73:6825","nonce":10519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":10519},{"type":"v1","addr":"172.21.15.73:6823","nonce":10519}]},"public_addr":"172.21.15.73:6819/10519","cluster_addr":"172.21.15.73:6821/10519","heartbeat_back_addr":"172.21.15.73:6825/10519","heartbeat_front_addr":"172.21.15.73:6823/10519","state":["exists","up"]},{"osd":2,"uuid":"9ad3daff-0fc8-42be-85fd-f8562ca4edbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":10521},{"type":"v1","addr":"172.21.15.73:6803","nonce":10521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":10521},{"type":"v1","addr":"172.21.15.73:6805","nonce":10521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":10521},{"type":"v1","addr":"172.21.15.73:6809","nonce":10521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":10521},{"type":"v1","addr":"172.21.15.73:6807","nonce":10521}]},"public_addr":"172.21.15.73:6803/10521","cluster_addr":"172.21.15.73:6805/10521","heartbeat_back_addr":"172.21.15.73:6809/10521","heartbeat_front_addr":"172.21.15.73:6807/10521","state":["exists","up"]},{"osd":3,"uuid":"71f751d2-0710-45fa-a123-7110f9677e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":10512},{"type":"v1","addr":"172.21.15.73:6811","nonce":10512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":10512},{"type":"v1","addr":"172.21.15.73:6813","nonce":10512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":10512},{"type":"v1","addr":"172.21.15.73:6817","nonce":10512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":10512},{"type":"v1","addr":"172.21.15.73:6815","nonce":10512}]},"public_addr":"172.21.15.73:6811/10512","cluster_addr":"172.21.15.73:6813/10512","heartbeat_back_addr":"172.21.15.73:6817/10512","heartbeat_front_addr":"172.21.15.73:6815/10512","state":["exists","up"]},{"osd":4,"uuid":"dd6650d1-98c9-45b8-9c44-9b2d800893ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":10188},{"type":"v1","addr":"172.21.15.150:6819","nonce":10188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":10188},{"type":"v1","addr":"172.21.15.150:6823","nonce":10188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":10188},{"type":"v1","addr":"172.21.15.150:6830","nonce":10188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":10188},{"type":"v1","addr":"172.21.15.150:6826","nonce":10188}]},"public_addr":"172.21.15.150:6819/10188","cluster_addr":"172.21.15.150:6823/10188","heartbeat_back_addr":"172.21.15.150:6830/10188","heartbeat_front_addr":"172.21.15.150:6826/10188","state":["exists","up"]},{"osd":5,"uuid":"83f6abc6-2f40-4eb3-9974-76b37affe377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":10186},{"type":"v1","addr":"172.21.15.150:6809","nonce":10186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":10186},{"type":"v1","addr":"172.21.15.150:6811","nonce":10186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":10186},{"type":"v1","addr":"172.21.15.150:6817","nonce":10186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":10186},{"type":"v1","addr":"172.21.15.150:6814","nonce":10186}]},"public_addr":"172.21.15.150:6809/10186","cluster_addr":"172.21.15.150:6811/10186","heartbeat_back_addr":"172.21.15.150:6817/10186","heartbeat_front_addr":"172.21.15.150:6814/10186","state":["exists","up"]},{"osd":6,"uuid":"801cbaef-0d42-4cad-8b67-792e5b6e8a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":10185},{"type":"v1","addr":"172.21.15.150:6815","nonce":10185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":10185},{"type":"v1","addr":"172.21.15.150:6822","nonce":10185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6829","nonce":10185},{"type":"v1","addr":"172.21.15.150:6831","nonce":10185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":10185},{"type":"v1","addr":"172.21.15.150:6827","nonce":10185}]},"public_addr":"172.21.15.150:6815/10185","cluster_addr":"172.21.15.150:6822/10185","heartbeat_back_addr":"172.21.15.150:6831/10185","heartbeat_front_addr":"172.21.15.150:6827/10185","state":["exists","up"]},{"osd":7,"uuid":"52bbe6c7-f98c-4858-8efd-5b1f261996f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":10187},{"type":"v1","addr":"172.21.15.150:6801","nonce":10187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":10187},{"type":"v1","addr":"172.21.15.150:6803","nonce":10187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":10187},{"type":"v1","addr":"172.21.15.150:6808","nonce":10187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":10187},{"type":"v1","addr":"172.21.15.150:6805","nonce":10187}]},"public_addr":"172.21.15.150:6801/10187","cluster_addr":"172.21.15.150:6803/10187","heartbeat_back_addr":"172.21.15.150:6808/10187","heartbeat_front_addr":"172.21.15.150:6805/10187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:41.319643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.957596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.149306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.314749+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.042325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.511291+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:40.088113+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-11T13:42:39.876144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-11T13:42:53.462 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-11T13:42:53.977 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2019-12-11T13:42:53.977 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-11T13:42:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2019-12-11T13:42:54.413 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-11T13:42:54.853 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2019-12-11T13:42:54.853 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-12-11T13:42:55.322 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2019-12-11T13:42:55.322 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-12-11T13:42:55.860 INFO:teuthology.orchestra.run.smithi073.stdout:60129542149 2019-12-11T13:42:55.861 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-12-11T13:42:56.417 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2019-12-11T13:42:56.418 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-12-11T13:42:56.955 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2019-12-11T13:42:56.956 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-12-11T13:42:57.544 INFO:teuthology.orchestra.run.smithi073.stdout:60129542149 2019-12-11T13:42:57.545 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-11T13:42:58.459 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2019-12-11T13:42:58.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.0 2019-12-11T13:42:58.480 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-11T13:42:59.147 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2019-12-11T13:42:59.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2019-12-11T13:42:59.161 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-11T13:43:00.032 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2019-12-11T13:43:00.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2019-12-11T13:43:00.046 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-12-11T13:43:00.756 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2019-12-11T13:43:00.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2019-12-11T13:43:00.776 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-12-11T13:43:01.501 INFO:teuthology.orchestra.run.smithi073.stdout:60129542150 2019-12-11T13:43:01.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.4 2019-12-11T13:43:01.516 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-12-11T13:43:02.400 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2019-12-11T13:43:02.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2019-12-11T13:43:02.419 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-12-11T13:43:03.228 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2019-12-11T13:43:03.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2019-12-11T13:43:03.242 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-12-11T13:43:04.037 INFO:teuthology.orchestra.run.smithi073.stdout:60129542150 2019-12-11T13:43:04.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.7 2019-12-11T13:43:04.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-11T13:43:04.051 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-11T13:43:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2019-12-11T13:43:04.764 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:43:04.777 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2019-12-11T13:43:03.362320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390208,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584512,"statfs":{"total":773094113280,"available":764502540288,"internally_reserved":8589934592,"allocated":1572864,"data_stored":507664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.130730+0000","last_change":"2019-12-11T13:42:48.535182+0000","last_active":"2019-12-11T13:42:49.130730+0000","last_peered":"2019-12-11T13:42:49.130730+0000","last_clean":"2019-12-11T13:42:49.130730+0000","last_became_active":"2019-12-11T13:42:48.498974+0000","last_became_peered":"2019-12-11T13:42:48.498974+0000","last_unstale":"2019-12-11T13:42:49.130730+0000","last_undegraded":"2019-12-11T13:42:49.130730+0000","last_fullsized":"2019-12-11T13:42:49.130730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.125188+0000","last_change":"2019-12-11T13:42:48.590681+0000","last_active":"2019-12-11T13:42:49.125188+0000","last_peered":"2019-12-11T13:42:49.125188+0000","last_clean":"2019-12-11T13:42:49.125188+0000","last_became_active":"2019-12-11T13:42:48.581395+0000","last_became_peered":"2019-12-11T13:42:48.581395+0000","last_unstale":"2019-12-11T13:42:49.125188+0000","last_undegraded":"2019-12-11T13:42:49.125188+0000","last_fullsized":"2019-12-11T13:42:49.125188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.764452+0000","last_change":"2019-12-11T13:42:49.733771+0000","last_active":"2019-12-11T13:42:49.764452+0000","last_peered":"2019-12-11T13:42:49.764452+0000","last_clean":"2019-12-11T13:42:49.764452+0000","last_became_active":"2019-12-11T13:42:49.678217+0000","last_became_peered":"2019-12-11T13:42:49.678217+0000","last_unstale":"2019-12-11T13:42:49.764452+0000","last_undegraded":"2019-12-11T13:42:49.764452+0000","last_fullsized":"2019-12-11T13:42:49.764452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.455290+0000","last_change":"2019-12-11T13:42:49.431665+0000","last_active":"2019-12-11T13:42:49.455290+0000","last_peered":"2019-12-11T13:42:49.455290+0000","last_clean":"2019-12-11T13:42:49.455290+0000","last_became_active":"2019-12-11T13:42:49.406742+0000","last_became_peered":"2019-12-11T13:42:49.406742+0000","last_unstale":"2019-12-11T13:42:49.455290+0000","last_undegraded":"2019-12-11T13:42:49.455290+0000","last_fullsized":"2019-12-11T13:42:49.455290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.867626+0000","last_change":"2019-12-11T13:42:49.819304+0000","last_active":"2019-12-11T13:42:49.867626+0000","last_peered":"2019-12-11T13:42:49.867626+0000","last_clean":"2019-12-11T13:42:49.867626+0000","last_became_active":"2019-12-11T13:42:49.759316+0000","last_became_peered":"2019-12-11T13:42:49.759316+0000","last_unstale":"2019-12-11T13:42:49.867626+0000","last_undegraded":"2019-12-11T13:42:49.867626+0000","last_fullsized":"2019-12-11T13:42:49.867626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.816869+0000","last_change":"2019-12-11T13:42:49.796876+0000","last_active":"2019-12-11T13:42:49.816869+0000","last_peered":"2019-12-11T13:42:49.816869+0000","last_clean":"2019-12-11T13:42:49.816869+0000","last_became_active":"2019-12-11T13:42:49.748328+0000","last_became_peered":"2019-12-11T13:42:49.748328+0000","last_unstale":"2019-12-11T13:42:49.816869+0000","last_undegraded":"2019-12-11T13:42:49.816869+0000","last_fullsized":"2019-12-11T13:42:49.816869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.866133+0000","last_change":"2019-12-11T13:42:49.849428+0000","last_active":"2019-12-11T13:42:49.866133+0000","last_peered":"2019-12-11T13:42:49.866133+0000","last_clean":"2019-12-11T13:42:49.866133+0000","last_became_active":"2019-12-11T13:42:49.836368+0000","last_became_peered":"2019-12-11T13:42:49.836368+0000","last_unstale":"2019-12-11T13:42:49.866133+0000","last_undegraded":"2019-12-11T13:42:49.866133+0000","last_fullsized":"2019-12-11T13:42:49.866133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.474836+0000","last_change":"2019-12-11T13:42:49.454280+0000","last_active":"2019-12-11T13:42:49.474836+0000","last_peered":"2019-12-11T13:42:49.474836+0000","last_clean":"2019-12-11T13:42:49.474836+0000","last_became_active":"2019-12-11T13:42:49.412817+0000","last_became_peered":"2019-12-11T13:42:49.412817+0000","last_unstale":"2019-12-11T13:42:49.474836+0000","last_undegraded":"2019-12-11T13:42:49.474836+0000","last_fullsized":"2019-12-11T13:42:49.474836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.244}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.116}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.037}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.168}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.150}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.198}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.714}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.414}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.538}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.168}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.828}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":98.063}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.453}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.902}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.191}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.451}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.659}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.726}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.993}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.277}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.629}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.596}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.518}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.961}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.518}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":98.978}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.485}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.734}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.185}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.678}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.644}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.825}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.334}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.639}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.565}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.868}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.296}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.034}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.409}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.485}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.310}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.235}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.859}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.284}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.554}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.191}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.460}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.920}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.023}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.900}]}]}]}} 2019-12-11T13:43:04.779 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-11T13:43:05.452 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2019-12-11T13:43:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:43:05.465 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2019-12-11T13:43:05.362675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390208,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584512,"statfs":{"total":773094113280,"available":764502540288,"internally_reserved":8589934592,"allocated":1572864,"data_stored":507664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.130730+0000","last_change":"2019-12-11T13:42:48.535182+0000","last_active":"2019-12-11T13:42:49.130730+0000","last_peered":"2019-12-11T13:42:49.130730+0000","last_clean":"2019-12-11T13:42:49.130730+0000","last_became_active":"2019-12-11T13:42:48.498974+0000","last_became_peered":"2019-12-11T13:42:48.498974+0000","last_unstale":"2019-12-11T13:42:49.130730+0000","last_undegraded":"2019-12-11T13:42:49.130730+0000","last_fullsized":"2019-12-11T13:42:49.130730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.125188+0000","last_change":"2019-12-11T13:42:48.590681+0000","last_active":"2019-12-11T13:42:49.125188+0000","last_peered":"2019-12-11T13:42:49.125188+0000","last_clean":"2019-12-11T13:42:49.125188+0000","last_became_active":"2019-12-11T13:42:48.581395+0000","last_became_peered":"2019-12-11T13:42:48.581395+0000","last_unstale":"2019-12-11T13:42:49.125188+0000","last_undegraded":"2019-12-11T13:42:49.125188+0000","last_fullsized":"2019-12-11T13:42:49.125188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.764452+0000","last_change":"2019-12-11T13:42:49.733771+0000","last_active":"2019-12-11T13:42:49.764452+0000","last_peered":"2019-12-11T13:42:49.764452+0000","last_clean":"2019-12-11T13:42:49.764452+0000","last_became_active":"2019-12-11T13:42:49.678217+0000","last_became_peered":"2019-12-11T13:42:49.678217+0000","last_unstale":"2019-12-11T13:42:49.764452+0000","last_undegraded":"2019-12-11T13:42:49.764452+0000","last_fullsized":"2019-12-11T13:42:49.764452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.455290+0000","last_change":"2019-12-11T13:42:49.431665+0000","last_active":"2019-12-11T13:42:49.455290+0000","last_peered":"2019-12-11T13:42:49.455290+0000","last_clean":"2019-12-11T13:42:49.455290+0000","last_became_active":"2019-12-11T13:42:49.406742+0000","last_became_peered":"2019-12-11T13:42:49.406742+0000","last_unstale":"2019-12-11T13:42:49.455290+0000","last_undegraded":"2019-12-11T13:42:49.455290+0000","last_fullsized":"2019-12-11T13:42:49.455290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.867626+0000","last_change":"2019-12-11T13:42:49.819304+0000","last_active":"2019-12-11T13:42:49.867626+0000","last_peered":"2019-12-11T13:42:49.867626+0000","last_clean":"2019-12-11T13:42:49.867626+0000","last_became_active":"2019-12-11T13:42:49.759316+0000","last_became_peered":"2019-12-11T13:42:49.759316+0000","last_unstale":"2019-12-11T13:42:49.867626+0000","last_undegraded":"2019-12-11T13:42:49.867626+0000","last_fullsized":"2019-12-11T13:42:49.867626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.816869+0000","last_change":"2019-12-11T13:42:49.796876+0000","last_active":"2019-12-11T13:42:49.816869+0000","last_peered":"2019-12-11T13:42:49.816869+0000","last_clean":"2019-12-11T13:42:49.816869+0000","last_became_active":"2019-12-11T13:42:49.748328+0000","last_became_peered":"2019-12-11T13:42:49.748328+0000","last_unstale":"2019-12-11T13:42:49.816869+0000","last_undegraded":"2019-12-11T13:42:49.816869+0000","last_fullsized":"2019-12-11T13:42:49.816869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.866133+0000","last_change":"2019-12-11T13:42:49.849428+0000","last_active":"2019-12-11T13:42:49.866133+0000","last_peered":"2019-12-11T13:42:49.866133+0000","last_clean":"2019-12-11T13:42:49.866133+0000","last_became_active":"2019-12-11T13:42:49.836368+0000","last_became_peered":"2019-12-11T13:42:49.836368+0000","last_unstale":"2019-12-11T13:42:49.866133+0000","last_undegraded":"2019-12-11T13:42:49.866133+0000","last_fullsized":"2019-12-11T13:42:49.866133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-11T13:42:49.474836+0000","last_change":"2019-12-11T13:42:49.454280+0000","last_active":"2019-12-11T13:42:49.474836+0000","last_peered":"2019-12-11T13:42:49.474836+0000","last_clean":"2019-12-11T13:42:49.474836+0000","last_became_active":"2019-12-11T13:42:49.412817+0000","last_became_peered":"2019-12-11T13:42:49.412817+0000","last_unstale":"2019-12-11T13:42:49.474836+0000","last_undegraded":"2019-12-11T13:42:49.474836+0000","last_fullsized":"2019-12-11T13:42:49.474836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-11T13:42:46.493542+0000","last_clean_scrub_stamp":"2019-12-11T13:42:46.493542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.722}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.949}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.723}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.727}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.826}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.480}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.057}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.506}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.594}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.797}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.251}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.756}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.158}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.976}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.783}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.991}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.090}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.228}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.592}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.834}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.671}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.232}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.582}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.956}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.734}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.185}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.678}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.644}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.825}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.334}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.639}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.565}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.868}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.296}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.034}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.409}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.485}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.310}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.235}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.859}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.095}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.300}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.578}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.376}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":42.433}]}]}]}} 2019-12-11T13:43:05.469 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-11T13:43:05.469 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-11T13:43:05.469 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-11T13:43:05.470 INFO:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-11T13:43:06.230 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:43:06.245 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-11T13:43:06.245 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-11T13:43:06.246 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-12-11T13:43:06.263 INFO:teuthology.run_tasks:Running task rgw... 2019-12-11T13:43:06.302 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-12-11T13:43:06.303 DEBUG:tasks.rgw:client list is ['client.0'] 2019-12-11T13:43:06.303 INFO:tasks.rgw:Creating data pools 2019-12-11T13:43:06.303 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-12-11T13:43:06.303 INFO:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2019-12-11T13:43:07.757 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.data' created 2019-12-11T13:43:07.770 INFO:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-12-11T13:43:08.857 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-12-11T13:43:08.875 INFO:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-12-11T13:43:10.266 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.index' created 2019-12-11T13:43:10.280 INFO:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-12-11T13:43:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-12-11T13:43:11.696 DEBUG:tasks.rgw:Pools created 2019-12-11T13:43:11.696 INFO:tasks.rgw:Configuring compression type = random 2019-12-11T13:43:11.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-11T13:43:11.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-11T13:43:11.697 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-11T13:43:11.835 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:11.860+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.150+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.150+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:14.234 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.260+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:14.234 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.260+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:14.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.265+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:14.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.265+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:14.244 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:14.270+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.737+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:15.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.742+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.742+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:15.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.747+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.747+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:15.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.751+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.752+0000 7f39c17feec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:43:15.726 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.752+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:15.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.756+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.756+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:15.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.761+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:15.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.761+0000 7f39c17feec0 10 Creating default zonegroup 2019-12-11T13:43:15.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.761+0000 7f39c17feec0 20 get_system_obj_state: rctx=0x7ffd0d79c460 obj=:.pools.avail state=0x56111ad0bea0 s->prefetch_data=0 2019-12-11T13:43:15.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:15.764+0000 7f39c17feec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-12-11T13:43:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:16.084+0000 7f39c17feec0 10 WARNING: store->list_zones() returned r=-2 2019-12-11T13:43:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:16.084+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:16.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:16.090+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:17.034 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.060+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.067+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:17.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.067+0000 7f39c17feec0 10 could not read realm id: (2) No such file or directory 2019-12-11T13:43:17.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.067+0000 7f39c17feec0 10 WARNING: failed to set zone as default, r=-22 2019-12-11T13:43:17.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.067+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.078+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.438+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.499+0000 7f39c17feec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-11T13:43:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.500+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.520 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.546+0000 7f39c17feec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-11T13:43:17.520 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.546+0000 7f39c17feec0 20 zonegroup default 2019-12-11T13:43:17.520 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.546+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.554+0000 7f39c17feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:17.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.554+0000 7f39c17feec0 10 Cannot find current period zone using local zone 2019-12-11T13:43:17.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.554+0000 7f39c17feec0 10 Using default name default 2019-12-11T13:43:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.554+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.568+0000 7f39af229700 0 -- 172.21.15.73:0/1802899344 >> [v2:172.21.15.73:6818/10519,v1:172.21.15.73:6819/10519] conn(0x56111ad01950 msgr2=0x56111ad03d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:43:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.568+0000 7f39c17feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.568+0000 7f39c17feec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:17.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.578+0000 7f39c17feec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-11T13:43:17.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.578+0000 7f39c17feec0 20 zone default found 2019-12-11T13:43:17.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.578+0000 7f39c17feec0 20 started sync module instance, tier type = 2019-12-11T13:43:17.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:17.578+0000 7f39c17feec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:43:21.816 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:21.843+0000 7f39aea28700 0 -- 172.21.15.73:0/1802899344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56111aced7f0 msgr2=0x56111acedc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T13:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=0 2019-12-11T13:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=1 2019-12-11T13:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=2 2019-12-11T13:43:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=3 2019-12-11T13:43:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=4 2019-12-11T13:43:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=5 2019-12-11T13:43:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.946+0000 7f39c17feec0 20 add_watcher() i=6 2019-12-11T13:43:22.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.999+0000 7f39c17feec0 20 add_watcher() i=7 2019-12-11T13:43:22.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.999+0000 7f39c17feec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:43:22.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:22.999+0000 7f397f7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:43:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:26.808+0000 7f39c17feec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-12-11T13:43:31.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:31.659+0000 7f39c17feec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-12-11T13:43:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.375+0000 7f38e5ffb700 20 reqs_thread_entry: start 2019-12-11T13:43:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.375+0000 7f38d77fe700 20 reqs_thread_entry: start 2019-12-11T13:43:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.375+0000 7f39c17feec0 20 init_complete bucket index max shards: 0 2019-12-11T13:43:35.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.376+0000 7f38d5ffb700 20 reqs_thread_entry: start 2019-12-11T13:43:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.812+0000 7f39c17feec0 20 remove_watcher() i=0 2019-12-11T13:43:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.812+0000 7f39c17feec0 2 removed watcher, disabling cache 2019-12-11T13:43:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.920+0000 7f39c17feec0 20 remove_watcher() i=1 2019-12-11T13:43:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:35.974+0000 7f39c17feec0 20 remove_watcher() i=2 2019-12-11T13:43:36.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.070+0000 7f39c17feec0 20 remove_watcher() i=3 2019-12-11T13:43:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.148+0000 7f39c17feec0 20 remove_watcher() i=4 2019-12-11T13:43:36.185 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.213+0000 7f39c17feec0 20 remove_watcher() i=5 2019-12-11T13:43:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.303+0000 7f39c17feec0 20 remove_watcher() i=6 2019-12-11T13:43:36.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.368+0000 7f39c17feec0 20 remove_watcher() i=7 2019-12-11T13:43:36.355 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2019-12-11T13:43:36.355 DEBUG:tasks.util.rgw: json result: [] 2019-12-11T13:43:36.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-11T13:43:36.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-11T13:43:36.356 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-12-11T13:43:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.577+0000 7f798dffb700 20 reqs_thread_entry: start 2019-12-11T13:43:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.577+0000 7f7a588afec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:36.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.589+0000 7f7a588afec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:36.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.589+0000 7f7a588afec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.616+0000 7f7a588afec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-11T13:43:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.616+0000 7f7a588afec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:36.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.621+0000 7f7a588afec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:36.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.621+0000 7f7a588afec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.634+0000 7f7a588afec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.634+0000 7f7a588afec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:36.643+0000 7f7a588afec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-11T13:43:36.843 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-11T13:43:36.843 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-11T13:43:36.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-11T13:43:36.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-11T13:43:36.845 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-11T13:43:37.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.041+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.047 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.074+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.047 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.074+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.085+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.085+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.092+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.092+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.103+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.367+0000 7f01d7b04ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:43:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.367+0000 7f01d7b04ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:43:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.367+0000 7f01d7b04ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:43:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.367+0000 7f01d7b04ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:43:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.367+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.399+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:37.373 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.399+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.421+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-11T13:43:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.421+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.437+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.437+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.457+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-11T13:43:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.457+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.466+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.466+0000 7f01d7b04ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:43:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.466+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.474+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.474+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.490+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.490+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.508+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-11T13:43:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.508+0000 7f01d7b04ec0 20 zonegroup default 2019-12-11T13:43:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.508+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.516+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.516+0000 7f01d7b04ec0 10 Cannot find current period zone using local zone 2019-12-11T13:43:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.516+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.524+0000 7f01d7b04ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:37.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.524+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.537+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.538+0000 7f01d7b04ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:37.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.556+0000 7f01d7b04ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-11T13:43:37.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.556+0000 7f01d7b04ec0 20 zone default found 2019-12-11T13:43:37.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.556+0000 7f01d7b04ec0 20 started sync module instance, tier type = 2019-12-11T13:43:37.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:37.556+0000 7f01d7b04ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:43:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=0 2019-12-11T13:43:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=1 2019-12-11T13:43:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=2 2019-12-11T13:43:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=3 2019-12-11T13:43:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=4 2019-12-11T13:43:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.005+0000 7f01d7b04ec0 20 add_watcher() i=5 2019-12-11T13:43:38.001 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.029+0000 7f01d7b04ec0 20 add_watcher() i=6 2019-12-11T13:43:38.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.043+0000 7f01d7b04ec0 20 add_watcher() i=7 2019-12-11T13:43:38.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.043+0000 7f01d7b04ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:43:38.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.043+0000 7f01957e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:43:38.017 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.045+0000 7f01c452d700 0 -- 172.21.15.73:0/2740287592 >> v2:172.21.15.150:3300/0 conn(0x55d376d199d0 msgr2=0x55d376d1be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T13:43:38.085 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:38.112+0000 7f01c552f700 0 -- 172.21.15.73:0/3373642058 >> [v2:172.21.15.73:6800/9547,v1:172.21.15.73:6801/9547] conn(0x7f0108022470 msgr2=0x7f0108024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:43:40.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.616+0000 7f00ff7fe700 20 reqs_thread_entry: start 2019-12-11T13:43:40.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.617+0000 7f00fd7fa700 20 reqs_thread_entry: start 2019-12-11T13:43:40.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.617+0000 7f01d7b04ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:43:40.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.617+0000 7f00ef7fe700 20 reqs_thread_entry: start 2019-12-11T13:43:40.793 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.820+0000 7f01d7b04ec0 20 remove_watcher() i=0 2019-12-11T13:43:40.793 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.820+0000 7f01d7b04ec0 2 removed watcher, disabling cache 2019-12-11T13:43:40.862 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.890+0000 7f01d7b04ec0 20 remove_watcher() i=1 2019-12-11T13:43:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:40.965+0000 7f01d7b04ec0 20 remove_watcher() i=2 2019-12-11T13:43:40.999 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.027+0000 7f01d7b04ec0 20 remove_watcher() i=3 2019-12-11T13:43:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.099+0000 7f01d7b04ec0 20 remove_watcher() i=4 2019-12-11T13:43:41.105 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.133+0000 7f01d7b04ec0 20 remove_watcher() i=5 2019-12-11T13:43:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.169+0000 7f01d7b04ec0 20 remove_watcher() i=6 2019-12-11T13:43:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.202+0000 7f01d7b04ec0 20 remove_watcher() i=7 2019-12-11T13:43:41.181 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2019-12-11T13:43:41.181 DEBUG:tasks.util.rgw: json result: [] 2019-12-11T13:43:41.182 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-12-11T13:43:41.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-11T13:43:41.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-11T13:43:41.182 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-12-11T13:43:41.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.379+0000 7fb14effd700 20 reqs_thread_entry: start 2019-12-11T13:43:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.379+0000 7fb219951ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.387+0000 7fb219951ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.387+0000 7fb219951ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.395+0000 7fb219951ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:41.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.395+0000 7fb219951ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.406+0000 7fb219951ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-11T13:43:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.406+0000 7fb219951ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.398 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.426+0000 7fb219951ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-11T13:43:41.533 INFO:teuthology.orchestra.run.smithi073.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-12-11T13:43:41.533 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-11T13:43:41.534 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-11T13:43:41.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-11T13:43:41.534 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-12-11T13:43:41.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.762+0000 7fb840ff9700 20 reqs_thread_entry: start 2019-12-11T13:43:41.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.762+0000 7fb8e3d86ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.777+0000 7fb8e3d86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:41.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.777+0000 7fb8e3d86ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.805+0000 7fb8e3d86ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-11T13:43:41.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.805+0000 7fb8e3d86ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.809+0000 7fb8e3d86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.809+0000 7fb8e3d86ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.817+0000 7fb8e3d86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:41.790 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.817+0000 7fb8e3d86ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:41.825+0000 7fb8e3d86ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-11T13:43:41.881 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-11T13:43:41.882 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-11T13:43:41.882 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-12-11T13:43:41.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-11T13:43:41.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-11T13:43:41.883 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-12-11T13:43:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.098+0000 7f905d0a0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.098+0000 7f8f927fc700 20 reqs_thread_entry: start 2019-12-11T13:43:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.107+0000 7f905d0a0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.107+0000 7f905d0a0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.116+0000 7f905d0a0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.116+0000 7f905d0a0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.125+0000 7f905d0a0ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-11T13:43:42.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.125+0000 7f905d0a0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.127 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.155+0000 7f905d0a0ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-11T13:43:42.191 INFO:teuthology.orchestra.run.smithi073.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-12-11T13:43:42.191 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-11T13:43:42.191 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-11T13:43:42.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-11T13:43:42.192 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-12-11T13:43:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.392+0000 7f5f9dffb700 20 reqs_thread_entry: start 2019-12-11T13:43:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.392+0000 7f6068af5ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.404+0000 7f6068af5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.404+0000 7f6068af5ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.425+0000 7f6068af5ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-11T13:43:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.425+0000 7f6068af5ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.432+0000 7f6068af5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:43:42.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.432+0000 7f6068af5ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.442+0000 7f6068af5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:43:42.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.442+0000 7f6068af5ec0 20 rados->read ofs=0 len=0 2019-12-11T13:43:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:43:42.454+0000 7f6068af5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:43:42.517 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-11T13:43:42.518 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-11T13:43:42.518 INFO:tasks.rgw:Starting rgw... 2019-12-11T13:43:42.518 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-12-11T13:43:42.518 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-12-11T13:43:42.519 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-12-11T13:43:42.519 INFO:tasks.rgw.client.0:Restarting daemon 2019-12-11T13:43:42.519 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-12-11T13:43:42.525 INFO:tasks.rgw.client.0:Started 2019-12-11T13:43:42.526 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:42.526 INFO:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:42.602 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-11T13:43:42.602 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2019-12-11T13:43:42.606 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi073.front.sepia.ceph.com:80; Connection refused 2019-12-11T13:43:42.606 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-11T13:43:43.607 INFO:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:43.677 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-11T13:43:43.677 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2019-12-11T13:43:43.681 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi073.front.sepia.ceph.com:80; Connection refused 2019-12-11T13:43:43.681 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-11T13:43:45.682 INFO:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:45.760 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-11T13:43:45.760 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2019-12-11T13:43:45.761 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi073.front.sepia.ceph.com:80; Connection refused 2019-12-11T13:43:45.761 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-11T13:43:49.762 INFO:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:49.819 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-11T13:43:49.820 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2019-12-11T13:43:49.824 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi073.front.sepia.ceph.com:80; Connection refused 2019-12-11T13:43:49.824 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-11T13:43:57.825 INFO:teuthology.orchestra.run.smithi073:> curl http://smithi073.front.sepia.ceph.com:80/ 2019-12-11T13:43:57.880 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-11T13:43:57.880 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2019-12-11T13:43:58.859 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 218 0 --:--:-- --:--:-- --:--:-- 218 2019-12-11T13:43:58.859 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2019-12-11T13:43:58.859 INFO:teuthology.run_tasks:Running task workunit... 2019-12-11T13:43:58.874 INFO:tasks.workunit:Pulling workunits from ref 827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:43:58.874 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-12-11T13:43:58.875 INFO:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2019-12-11T13:43:58.933 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-12-11T13:43:58.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-11T13:43:58.934 INFO:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-11T13:43:58.994 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-12-11T13:43:58.994 INFO:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-12-11T13:43:59.054 INFO:tasks.workunit:timeout=3h 2019-12-11T13:43:59.054 INFO:tasks.workunit:cleanup=True 2019-12-11T13:43:59.055 INFO:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 827e03c8a6b1e17d93dcaf79724437bac291c35b 2019-12-11T13:43:59.342 INFO:tasks.workunit.client.0.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-12-11T13:45:04.851 INFO:tasks.workunit.client.0.smithi073.stderr:Note: checking out '827e03c8a6b1e17d93dcaf79724437bac291c35b'. 2019-12-11T13:45:04.851 INFO:tasks.workunit.client.0.smithi073.stderr: 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by performing another checkout. 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr: 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2019-12-11T13:45:04.852 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-12-11T13:45:04.853 INFO:tasks.workunit.client.0.smithi073.stderr: 2019-12-11T13:45:04.853 INFO:tasks.workunit.client.0.smithi073.stderr: git checkout -b new_branch_name 2019-12-11T13:45:04.853 INFO:tasks.workunit.client.0.smithi073.stderr: 2019-12-11T13:45:04.853 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 827e03c... Merge branch 'rgw/public-buckets' of https://github.com/theanalyst/ceph into wip-abhi-testing-2019-12-04-1433 2019-12-11T13:45:04.854 INFO:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-12-11T13:45:04.909 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-12-11T13:45:04.911 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-11T13:45:04.911 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-12-11T13:45:05.404 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-12-11T13:45:05.482 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-12-11T13:45:05.514 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-11T13:45:05.516 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-11T13:45:05.516 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-12-11T13:45:05.548 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-11T13:45:05.607 DEBUG:teuthology.orchestra.remote:smithi073:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-12-11T13:45:05.656 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-12-11T13:45:05.656 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-12-11T13:45:05.657 INFO:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=827e03c8a6b1e17d93dcaf79724437bac291c35b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-12-11T13:45:05.710 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2019-12-11T13:45:05.710 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 11 tests from 1 test suite. 2019-12-11T13:45:05.710 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2019-12-11T13:45:05.711 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from ClsLock 2019-12-11T13:45:05.711 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-12-11T13:45:08.531 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:08.532 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2019-12-11T13:45:08.532 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:08.532 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:08.532 INFO:tasks.workunit.client.0.smithi073.stdout: client.4551 expiration=2019-12-11T13:47:08.433620+0000 addr=v1:172.21.15.73:0/177331794 cookie= 2019-12-11T13:45:08.660 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:08.660 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2019-12-11T13:45:08.660 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:08.660 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:08.661 INFO:tasks.workunit.client.0.smithi073.stdout: client.4361 expiration=0.000000 addr=v1:172.21.15.73:0/2170215669 cookie= 2019-12-11T13:45:08.661 INFO:tasks.workunit.client.0.smithi073.stdout: client.4551 expiration=2019-12-11T13:47:08.647566+0000 addr=v1:172.21.15.73:0/177331794 cookie= 2019-12-11T13:45:08.741 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:08.742 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2019-12-11T13:45:08.742 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:08.742 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:08.742 INFO:tasks.workunit.client.0.smithi073.stdout: client.4361 expiration=0.000000 addr=v1:172.21.15.73:0/2170215669 cookie= 2019-12-11T13:45:09.947 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMultiLocking (4237 ms) 2019-12-11T13:45:09.947 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMeta 2019-12-11T13:45:12.892 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2019-12-11T13:45:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: client.4501 expiration=0.000000 addr=v1:172.21.15.73:0/3206380219 cookie= 2019-12-11T13:45:12.971 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2019-12-11T13:45:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: tag: new_tag 2019-12-11T13:45:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: client.4495 expiration=0.000000 addr=v1:172.21.15.73:0/4241889319 cookie= 2019-12-11T13:45:13.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMeta (3394 ms) 2019-12-11T13:45:13.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestCookie 2019-12-11T13:45:16.373 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:16.373 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2019-12-11T13:45:16.374 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:16.374 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:16.456 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2019-12-11T13:45:16.456 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2019-12-11T13:45:16.456 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2019-12-11T13:45:16.456 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2019-12-11T13:45:16.457 INFO:tasks.workunit.client.0.smithi073.stdout: client.4510 expiration=0.000000 addr=v1:172.21.15.73:0/1807418475 cookie= 2019-12-11T13:45:16.457 INFO:tasks.workunit.client.0.smithi073.stdout: client.4510 expiration=0.000000 addr=v1:172.21.15.73:0/1807418475 cookie=new cookie 2019-12-11T13:45:16.878 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestCookie (3537 ms) 2019-12-11T13:45:16.878 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-12-11T13:45:20.417 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMultipleLocks (3540 ms) 2019-12-11T13:45:20.417 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestLockDuration 2019-12-11T13:45:28.644 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestLockDuration (8228 ms) 2019-12-11T13:45:28.644 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-12-11T13:45:31.943 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestAssertLocked (3299 ms) 2019-12-11T13:45:31.944 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestSetCookie 2019-12-11T13:45:35.479 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestSetCookie (3536 ms) 2019-12-11T13:45:35.479 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestRenew 2019-12-11T13:45:57.577 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestRenew (22100 ms) 2019-12-11T13:45:57.577 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-12-11T13:46:04.640 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7062 ms) 2019-12-11T13:46:04.640 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-12-11T13:46:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8238 ms) 2019-12-11T13:46:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-12-11T13:46:20.621 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7746 ms) 2019-12-11T13:46:20.621 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from ClsLock (74917 ms total) 2019-12-11T13:46:20.622 INFO:tasks.workunit.client.0.smithi073.stdout: 2019-12-11T13:46:20.622 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2019-12-11T13:46:20.622 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 11 tests from 1 test suite ran. (74917 ms total) 2019-12-11T13:46:20.622 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 11 tests. 2019-12-11T13:46:20.623 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-11T13:46:20.624 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-11T13:46:20.780 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-12-11T13:46:20.781 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-12-11T13:46:20.781 INFO:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=827e03c8a6b1e17d93dcaf79724437bac291c35b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-12-11T13:46:20.841 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2019-12-11T13:46:20.841 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 4 tests from 1 test suite. 2019-12-11T13:46:20.841 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2019-12-11T13:46:20.841 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from cls_log 2019-12-11T13:46:20.842 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-12-11T13:46:24.063 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.test_log_add_same_time (3222 ms) 2019-12-11T13:46:24.063 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-12-11T13:46:27.589 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.test_log_add_different_time (3526 ms) 2019-12-11T13:46:27.589 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.trim_by_time 2019-12-11T13:46:32.180 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.trim_by_time (4591 ms) 2019-12-11T13:46:32.180 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.trim_by_marker 2019-12-11T13:46:35.539 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.trim_by_marker (3357 ms) 2019-12-11T13:46:35.539 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from cls_log (14697 ms total) 2019-12-11T13:46:35.539 INFO:tasks.workunit.client.0.smithi073.stdout: 2019-12-11T13:46:35.539 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2019-12-11T13:46:35.539 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 4 tests from 1 test suite ran. (14697 ms total) 2019-12-11T13:46:35.540 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 4 tests. 2019-12-11T13:46:35.540 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-11T13:46:35.540 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-11T13:46:35.612 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-12-11T13:46:35.613 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-12-11T13:46:35.613 INFO:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=827e03c8a6b1e17d93dcaf79724437bac291c35b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-12-11T13:46:35.675 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2019-12-11T13:46:35.675 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 5 tests from 1 test suite. 2019-12-11T13:46:35.675 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2019-12-11T13:46:35.675 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 5 tests from cls_rgw 2019-12-11T13:46:35.675 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.test_implicit 2019-12-11T13:46:39.200 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.test_implicit (3525 ms) 2019-12-11T13:46:39.200 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-12-11T13:46:42.661 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3462 ms) 2019-12-11T13:46:42.661 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.test_put_snap 2019-12-11T13:46:50.786 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T13:46:50.769+0000 38794700 -1 osd.2 pg_epoch: 101 pg[25.6( v 100'4 (0'0,100'4] local-lis/les=97/98 n=2 ec=97/97 lis/c=97/97 les/c/f=98/98/0 sis=97) [2,1] r=0 lpr=97 crt=99'3 lcod 99'3 mlcod 99'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-12-11T13:46:52.795 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.test_put_snap (10135 ms) 2019-12-11T13:46:52.795 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.test_explicit 2019-12-11T13:46:56.273 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.test_explicit (3477 ms) 2019-12-11T13:46:56.273 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.set 2019-12-11T13:46:59.789 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.set (3516 ms) 2019-12-11T13:46:59.790 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 5 tests from cls_rgw (24115 ms total) 2019-12-11T13:46:59.790 INFO:tasks.workunit.client.0.smithi073.stdout: 2019-12-11T13:46:59.790 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2019-12-11T13:46:59.790 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 5 tests from 1 test suite ran. (24115 ms total) 2019-12-11T13:46:59.790 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 5 tests. 2019-12-11T13:46:59.791 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-11T13:46:59.791 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-11T13:46:59.862 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-12-11T13:46:59.863 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-12-11T13:46:59.863 INFO:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=827e03c8a6b1e17d93dcaf79724437bac291c35b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-12-11T13:46:59.918 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2019-12-11T13:46:59.918 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 13 tests from 1 test suite. 2019-12-11T13:46:59.919 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2019-12-11T13:46:59.919 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from cls_rgw 2019-12-11T13:47:01.897 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_basic 2019-12-11T13:47:03.614 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_basic (1720 ms) 2019-12-11T13:47:03.614 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-12-11T13:47:04.999 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1385 ms) 2019-12-11T13:47:04.999 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_remove_object 2019-12-11T13:47:06.950 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_remove_object (1951 ms) 2019-12-11T13:47:06.950 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_suggest 2019-12-11T13:47:31.310 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_suggest (24363 ms) 2019-12-11T13:47:31.311 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_list 2019-12-11T13:47:32.922 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_list (1613 ms) 2019-12-11T13:47:32.923 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.bi_list 2019-12-11T13:47:36.044 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.bi_list (3122 ms) 2019-12-11T13:47:36.045 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_set 2019-12-11T13:47:36.435 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_set (390 ms) 2019-12-11T13:47:36.435 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_list 2019-12-11T13:47:37.032 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_list (598 ms) 2019-12-11T13:47:37.033 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_defer 2019-12-11T13:47:44.684 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_defer (7652 ms) 2019-12-11T13:47:44.684 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_basic 2019-12-11T13:47:52.985 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_basic (8302 ms) 2019-12-11T13:47:52.986 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-12-11T13:47:53.045 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_clear_no_obj (60 ms) 2019-12-11T13:47:53.046 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_clear 2019-12-11T13:48:02.406 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_clear (9361 ms) 2019-12-11T13:48:02.406 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-12-11T13:48:04.381 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.bi_log_trim (1975 ms) 2019-12-11T13:48:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from cls_rgw (62493 ms total) 2019-12-11T13:48:04.641 INFO:tasks.workunit.client.0.smithi073.stdout: 2019-12-11T13:48:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2019-12-11T13:48:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 13 tests from 1 test suite ran. (64729 ms total) 2019-12-11T13:48:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 13 tests. 2019-12-11T13:48:04.642 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-11T13:48:04.643 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-11T13:48:04.762 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-12-11T13:48:04.762 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-12-11T13:48:04.763 INFO:teuthology.orchestra.run.smithi073:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=827e03c8a6b1e17d93dcaf79724437bac291c35b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-12-11T13:48:04.834 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 6 tests from 1 test suite. 2019-12-11T13:48:04.834 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2019-12-11T13:48:06.731 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 6 tests from rgw_gc_log 2019-12-11T13:48:06.732 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-12-11T13:48:07.269 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.init_existing_queue (537 ms) 2019-12-11T13:48:07.269 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-12-11T13:48:07.359 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.init_existing_omap (89 ms) 2019-12-11T13:48:07.359 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-12-11T13:48:07.458 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (99 ms) 2019-12-11T13:48:07.458 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-12-11T13:48:07.514 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (57 ms) 2019-12-11T13:48:07.514 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-12-11T13:48:07.610 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.defer1_after_init (95 ms) 2019-12-11T13:48:07.610 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-12-11T13:48:07.675 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.defer2_before_init (65 ms) 2019-12-11T13:48:07.675 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 6 tests from rgw_gc_log (943 ms total) 2019-12-11T13:48:07.675 INFO:tasks.workunit.client.0.smithi073.stdout: 2019-12-11T13:48:07.675 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2019-12-11T13:48:07.903 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 6 tests from 1 test suite ran. (3069 ms total) 2019-12-11T13:48:07.903 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 6 tests. 2019-12-11T13:48:07.905 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-11T13:48:07.906 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-11T13:48:07.984 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-12-11T13:48:07.985 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-12-11T13:48:08.211 DEBUG:teuthology.parallel:result is None 2019-12-11T13:48:08.212 INFO:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-12-11T13:48:08.271 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-12-11T13:48:08.271 INFO:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-11T13:48:08.320 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-12-11T13:48:08.320 INFO:teuthology.run_tasks:Running task ragweed... 2019-12-11T13:48:08.334 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-12-11T13:48:08.334 INFO:tasks.ragweed:Downloading ragweed... 2019-12-11T13:48:08.334 INFO:tasks.ragweed:Using branch 'wip-abhi-testing-2019-12-04-1433' for ragweed 2019-12-11T13:48:08.345 INFO:teuthology.orchestra.run.smithi073:> git clone -b wip-abhi-testing-2019-12-04-1433 git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-11T13:48:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:fatal: Remote branch wip-abhi-testing-2019-12-04-1433 not found in upstream origin 2019-12-11T13:48:08.407 INFO:teuthology.orchestra.run.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-11T13:48:08.407 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-12-11T13:48:08.407 INFO:teuthology.orchestra.run.smithi073:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-11T13:48:08.495 INFO:teuthology.orchestra.run.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-11T13:48:08.598 INFO:tasks.ragweed:Creating rgw users... 2019-12-11T13:48:08.598 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-12-11T13:48:08.598 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RBQHVWTMYRDZXJIYJYGQ --secret qsriupM4Fj3C/+kcyHay+9ISHsu3O7LRHqKuZP9NUSYvo10q4bV4Ew== --email sysuser.client.0+test@test.test --system true 2019-12-11T13:48:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.774+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.828+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.828+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.837+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.837+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.844+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:08.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.844+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.853+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.971+0000 7f09cb4b0ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:48:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.971+0000 7f09cb4b0ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:48:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.971+0000 7f09cb4b0ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:48:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.971+0000 7f09cb4b0ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:48:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.971+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.978+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.978+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.991+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:48:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:08.991+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.008+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.008+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.029+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:48:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.029+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.036+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.037+0000 7f09cb4b0ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:48:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.037+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:08.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.043+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:08.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.043+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.005 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.053+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:09.005 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.053+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.063+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:48:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.063+0000 7f09cb4b0ec0 20 zonegroup default 2019-12-11T13:48:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.063+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.020 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.069+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:09.020 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.069+0000 7f09cb4b0ec0 10 Cannot find current period zone using local zone 2019-12-11T13:48:09.020 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.069+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.025 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.074+0000 7f09cb4b0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:09.025 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.074+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.083+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:09.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.083+0000 7f09cb4b0ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.103+0000 7f09cb4b0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:48:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.103+0000 7f09cb4b0ec0 20 zone default found 2019-12-11T13:48:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.103+0000 7f09cb4b0ec0 20 started sync module instance, tier type = 2019-12-11T13:48:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.103+0000 7f09cb4b0ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:48:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=0 2019-12-11T13:48:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=1 2019-12-11T13:48:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=2 2019-12-11T13:48:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=3 2019-12-11T13:48:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=4 2019-12-11T13:48:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=5 2019-12-11T13:48:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.489+0000 7f09cb4b0ec0 20 add_watcher() i=6 2019-12-11T13:48:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.528+0000 7f09cb4b0ec0 20 add_watcher() i=7 2019-12-11T13:48:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.528+0000 7f09cb4b0ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:48:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.528+0000 7f0988fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:48:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.530+0000 7f09b8edb700 0 -- 172.21.15.73:0/3438275974 >> v1:172.21.15.73:6789/0 conn(0x5619e3bf0b70 legacy=0x5619e3bf4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T13:48:09.523 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:09.572+0000 7f09b7ed9700 0 -- 172.21.15.73:0/3904239402 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x5619e3c0a410 msgr2=0x5619e3c0c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T13:48:11.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.215+0000 7f08faffd700 20 reqs_thread_entry: start 2019-12-11T13:48:11.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.215+0000 7f08f8ff9700 20 reqs_thread_entry: start 2019-12-11T13:48:11.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.215+0000 7f09cb4b0ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:48:11.168 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.216+0000 7f08eeffd700 20 reqs_thread_entry: start 2019-12-11T13:48:11.168 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.216+0000 7f09cb4b0ec0 20 get_system_obj_state: rctx=0x7ffcb51c5f48 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5619e3c76f60 s->prefetch_data=0 2019-12-11T13:48:11.168 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.216+0000 7f09cb4b0ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-11T13:48:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.224+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-12-11T13:48:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.224+0000 7f09cb4b0ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-11T13:48:11.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.224+0000 7f09cb4b0ec0 20 get_system_obj_state: rctx=0x7ffcb51c5f58 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x5619e3c78cf0 s->prefetch_data=0 2019-12-11T13:48:11.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.224+0000 7f09cb4b0ec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-12-11T13:48:11.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.236+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-12-11T13:48:11.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.236+0000 7f09cb4b0ec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-11T13:48:11.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.236+0000 7f09cb4b0ec0 20 get_system_obj_state: rctx=0x7ffcb51c5f58 obj=default.rgw.meta:users.keys:RBQHVWTMYRDZXJIYJYGQ state=0x5619e3c78cf0 s->prefetch_data=0 2019-12-11T13:48:11.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.236+0000 7f09cb4b0ec0 10 cache get: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ : miss 2019-12-11T13:48:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.244+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ info.flags=0x0 2019-12-11T13:48:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.244+0000 7f09cb4b0ec0 10 adding default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ to cache LRU end 2019-12-11T13:48:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.244+0000 7f09cb4b0ec0 20 get_system_obj_state: rctx=0x7ffcb51c5b68 obj=default.rgw.meta:users.keys:RBQHVWTMYRDZXJIYJYGQ state=0x5619e3c78cf0 s->prefetch_data=0 2019-12-11T13:48:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.244+0000 7f09cb4b0ec0 10 cache get: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ : type miss (requested=0x6, cached=0x0) 2019-12-11T13:48:11.200 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.249+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ info.flags=0x0 2019-12-11T13:48:11.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.249+0000 7f09cb4b0ec0 10 moving default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ to cache LRU end 2019-12-11T13:48:11.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.249+0000 7f09cb4b0ec0 20 get_system_obj_state: rctx=0x7ffcb51c5ce8 obj=default.rgw.meta:users.keys:RBQHVWTMYRDZXJIYJYGQ state=0x5619e3c78cf0 s->prefetch_data=0 2019-12-11T13:48:11.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.249+0000 7f09cb4b0ec0 10 cache get: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ : type miss (requested=0x6, cached=0x0) 2019-12-11T13:48:11.205 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.254+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ info.flags=0x0 2019-12-11T13:48:11.205 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.254+0000 7f09cb4b0ec0 10 moving default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ to cache LRU end 2019-12-11T13:48:11.267 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.313+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-11T13:48:11.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.313+0000 7f09cb4b0ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-11T13:48:11.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.313+0000 7f09cb4b0ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-12-11T13:48:11.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.342+0000 7f099dffb700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94669195033360 notifier 4686 bl.length()=637 2019-12-11T13:48:11.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.342+0000 7f099dffb700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-11T13:48:11.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.342+0000 7f099dffb700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-11T13:48:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.919+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-11T13:48:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.919+0000 7f09cb4b0ec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-11T13:48:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.919+0000 7f09cb4b0ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-12-11T13:48:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.961+0000 7f099dffb700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94669195050080 notifier 4686 bl.length()=202 2019-12-11T13:48:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.961+0000 7f099dffb700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-11T13:48:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:11.961+0000 7f099dffb700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-11T13:48:12.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.292+0000 7f09cb4b0ec0 10 cache put: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ info.flags=0x7 2019-12-11T13:48:12.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.292+0000 7f09cb4b0ec0 10 moving default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ to cache LRU end 2019-12-11T13:48:12.244 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.292+0000 7f09cb4b0ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2019-12-11T13:48:12.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.301+0000 7f099dffb700 10 RGWWatcher::handle_notify() notify_id 515396075521 cookie 94669195052368 notifier 4686 bl.length()=190 2019-12-11T13:48:12.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.301+0000 7f099dffb700 10 cache put: name=default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ info.flags=0x7 2019-12-11T13:48:12.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.301+0000 7f099dffb700 10 moving default.rgw.meta+users.keys+RBQHVWTMYRDZXJIYJYGQ to cache LRU end 2019-12-11T13:48:12.392 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T13:48:12.392 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "sysuser.client.0", 2019-12-11T13:48:12.392 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. sysuser.client.0", 2019-12-11T13:48:12.393 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "sysuser.client.0+test@test.test", 2019-12-11T13:48:12.393 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T13:48:12.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T13:48:12.393 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T13:48:12.393 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T13:48:12.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T13:48:12.394 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "sysuser.client.0", 2019-12-11T13:48:12.394 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "RBQHVWTMYRDZXJIYJYGQ", 2019-12-11T13:48:12.394 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "qsriupM4Fj3C/+kcyHay+9ISHsu3O7LRHqKuZP9NUSYvo10q4bV4Ew==" 2019-12-11T13:48:12.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T13:48:12.395 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T13:48:12.395 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T13:48:12.395 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2019-12-11T13:48:12.396 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T13:48:12.396 INFO:teuthology.orchestra.run.smithi073.stdout: "system": "true", 2019-12-11T13:48:12.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T13:48:12.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T13:48:12.396 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T13:48:12.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T13:48:12.397 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:48:12.397 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:48:12.397 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:48:12.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:48:12.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:48:12.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:48:12.398 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T13:48:12.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:48:12.399 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:48:12.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:48:12.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:48:12.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:48:12.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:48:12.400 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T13:48:12.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T13:48:12.406 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T13:48:12.406 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T13:48:12.406 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:12.472 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.521+0000 7f09cb4b0ec0 20 remove_watcher() i=0 2019-12-11T13:48:12.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.521+0000 7f09cb4b0ec0 2 removed watcher, disabling cache 2019-12-11T13:48:12.545 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.594+0000 7f09cb4b0ec0 20 remove_watcher() i=1 2019-12-11T13:48:12.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.647+0000 7f09cb4b0ec0 20 remove_watcher() i=2 2019-12-11T13:48:12.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.712+0000 7f09cb4b0ec0 20 remove_watcher() i=3 2019-12-11T13:48:12.698 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.747+0000 7f09cb4b0ec0 20 remove_watcher() i=4 2019-12-11T13:48:12.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.783+0000 7f09cb4b0ec0 20 remove_watcher() i=5 2019-12-11T13:48:12.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.846+0000 7f09cb4b0ec0 20 remove_watcher() i=6 2019-12-11T13:48:12.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:12.908+0000 7f09cb4b0ec0 20 remove_watcher() i=7 2019-12-11T13:48:12.870 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-12-11T13:48:12.871 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key FPWHOIATUMXQOQHZATYV --secret 8MplA/or7g8shLB8FMkzTNwlb1ROLyWb7a3jiTepGGU2g+pAe401YA== --email ragweed.client.0+test@test.test --system false 2019-12-11T13:48:13.038 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.087+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.118+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.118+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.136+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.136+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.094 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.144+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.144+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.105 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.154+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:13.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.344+0000 7f58f78a2ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:48:13.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.344+0000 7f58f78a2ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:48:13.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.344+0000 7f58f78a2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:48:13.296 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.344+0000 7f58f78a2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:48:13.296 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.344+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.359+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:13.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.359+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.381+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:48:13.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.382+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.395+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.395+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.362 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.411+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:48:13.362 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.411+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.421+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.421+0000 7f58f78a2ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:48:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.421+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.425+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.425+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.433+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.433+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.441+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:48:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.441+0000 7f58f78a2ec0 20 zonegroup default 2019-12-11T13:48:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.441+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.446+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.446+0000 7f58f78a2ec0 10 Cannot find current period zone using local zone 2019-12-11T13:48:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.446+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.452+0000 7f58f78a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:48:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.452+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.460+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:48:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.460+0000 7f58f78a2ec0 20 rados->read ofs=0 len=0 2019-12-11T13:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.469+0000 7f58f78a2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.469+0000 7f58f78a2ec0 20 zone default found 2019-12-11T13:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.469+0000 7f58f78a2ec0 20 started sync module instance, tier type = 2019-12-11T13:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.469+0000 7f58f78a2ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:48:13.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=0 2019-12-11T13:48:13.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=1 2019-12-11T13:48:13.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=2 2019-12-11T13:48:13.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=3 2019-12-11T13:48:13.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=4 2019-12-11T13:48:13.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=5 2019-12-11T13:48:13.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.784+0000 7f58f78a2ec0 20 add_watcher() i=6 2019-12-11T13:48:13.766 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.815+0000 7f58f78a2ec0 20 add_watcher() i=7 2019-12-11T13:48:13.766 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.815+0000 7f58f78a2ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:48:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.815+0000 7f58b57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:48:13.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:13.820+0000 7f58e4acc700 0 -- 172.21.15.73:0/1348803412 >> v2:172.21.15.150:3300/0 conn(0x5650e07aceb0 msgr2=0x5650e07af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T13:48:13.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:14.022+0000 7f58e4acc700 0 --2- 172.21.15.73:0/1348803412 >> v2:172.21.15.150:3300/0 conn(0x5650e07aceb0 0x5650e07af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T13:48:14.036 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:14.085+0000 7f58e4acc700 0 -- 172.21.15.73:0/2557243942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650e07b3330 msgr2=0x5650e07b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:48:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.533+0000 7f58277fe700 20 reqs_thread_entry: start 2019-12-11T13:48:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.533+0000 7f58257fa700 20 reqs_thread_entry: start 2019-12-11T13:48:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.533+0000 7f58f78a2ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:48:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.534+0000 7f58137fe700 20 reqs_thread_entry: start 2019-12-11T13:48:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.534+0000 7f58f78a2ec0 20 get_system_obj_state: rctx=0x7ffcc7643db8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5650e082ab60 s->prefetch_data=0 2019-12-11T13:48:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.534+0000 7f58f78a2ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-11T13:48:15.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.540+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-12-11T13:48:15.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.540+0000 7f58f78a2ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-11T13:48:15.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.540+0000 7f58f78a2ec0 20 get_system_obj_state: rctx=0x7ffcc7643dc8 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x5650e082c8f0 s->prefetch_data=0 2019-12-11T13:48:15.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.540+0000 7f58f78a2ec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-12-11T13:48:15.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.545+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-12-11T13:48:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.545+0000 7f58f78a2ec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-11T13:48:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.545+0000 7f58f78a2ec0 20 get_system_obj_state: rctx=0x7ffcc7643dc8 obj=default.rgw.meta:users.keys:FPWHOIATUMXQOQHZATYV state=0x5650e082c8f0 s->prefetch_data=0 2019-12-11T13:48:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.545+0000 7f58f78a2ec0 10 cache get: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV : miss 2019-12-11T13:48:15.500 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.550+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV info.flags=0x0 2019-12-11T13:48:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.550+0000 7f58f78a2ec0 10 adding default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV to cache LRU end 2019-12-11T13:48:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.550+0000 7f58f78a2ec0 20 get_system_obj_state: rctx=0x7ffcc76439d8 obj=default.rgw.meta:users.keys:FPWHOIATUMXQOQHZATYV state=0x5650e082c8f0 s->prefetch_data=0 2019-12-11T13:48:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.550+0000 7f58f78a2ec0 10 cache get: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV : type miss (requested=0x6, cached=0x0) 2019-12-11T13:48:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.554+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV info.flags=0x0 2019-12-11T13:48:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.554+0000 7f58f78a2ec0 10 moving default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV to cache LRU end 2019-12-11T13:48:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.554+0000 7f58f78a2ec0 20 get_system_obj_state: rctx=0x7ffcc7643b58 obj=default.rgw.meta:users.keys:FPWHOIATUMXQOQHZATYV state=0x5650e082c8f0 s->prefetch_data=0 2019-12-11T13:48:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.554+0000 7f58f78a2ec0 10 cache get: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV : type miss (requested=0x6, cached=0x0) 2019-12-11T13:48:15.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.559+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV info.flags=0x0 2019-12-11T13:48:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.559+0000 7f58f78a2ec0 10 moving default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV to cache LRU end 2019-12-11T13:48:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.606+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-11T13:48:15.557 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.606+0000 7f58f78a2ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-11T13:48:15.557 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.606+0000 7f58f78a2ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-12-11T13:48:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.616+0000 7f58da2c7700 10 RGWWatcher::handle_notify() notify_id 515396075521 cookie 94905363425040 notifier 4704 bl.length()=637 2019-12-11T13:48:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.616+0000 7f58da2c7700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-11T13:48:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.616+0000 7f58da2c7700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-11T13:48:15.815 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.864+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-11T13:48:15.815 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.864+0000 7f58f78a2ec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-11T13:48:15.815 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.864+0000 7f58f78a2ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-12-11T13:48:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.878+0000 7f58da2c7700 10 RGWWatcher::handle_notify() notify_id 515396075522 cookie 94905363406832 notifier 4704 bl.length()=202 2019-12-11T13:48:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.878+0000 7f58da2c7700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-11T13:48:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:15.878+0000 7f58da2c7700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-11T13:48:15.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.019+0000 7f58f78a2ec0 10 cache put: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV info.flags=0x7 2019-12-11T13:48:15.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.019+0000 7f58f78a2ec0 10 moving default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV to cache LRU end 2019-12-11T13:48:15.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.019+0000 7f58f78a2ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2019-12-11T13:48:16.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.061+0000 7f58da2c7700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94905363430976 notifier 4704 bl.length()=190 2019-12-11T13:48:16.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.061+0000 7f58da2c7700 10 cache put: name=default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV info.flags=0x7 2019-12-11T13:48:16.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.061+0000 7f58da2c7700 10 moving default.rgw.meta+users.keys+FPWHOIATUMXQOQHZATYV to cache LRU end 2019-12-11T13:48:16.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T13:48:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "ragweed.client.0", 2019-12-11T13:48:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. ragweed.client.0", 2019-12-11T13:48:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "ragweed.client.0+test@test.test", 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T13:48:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "ragweed.client.0", 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "FPWHOIATUMXQOQHZATYV", 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "8MplA/or7g8shLB8FMkzTNwlb1ROLyWb7a3jiTepGGU2g+pAe401YA==" 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2019-12-11T13:48:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "system": "true", 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:48:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:48:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T13:48:16.052 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T13:48:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:16.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.130+0000 7f58f78a2ec0 20 remove_watcher() i=0 2019-12-11T13:48:16.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.130+0000 7f58f78a2ec0 2 removed watcher, disabling cache 2019-12-11T13:48:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.171+0000 7f58f78a2ec0 20 remove_watcher() i=1 2019-12-11T13:48:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.220+0000 7f58f78a2ec0 20 remove_watcher() i=2 2019-12-11T13:48:16.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.301+0000 7f58f78a2ec0 20 remove_watcher() i=3 2019-12-11T13:48:16.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.344+0000 7f58f78a2ec0 20 remove_watcher() i=4 2019-12-11T13:48:16.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.395+0000 7f58f78a2ec0 20 remove_watcher() i=5 2019-12-11T13:48:16.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.431+0000 7f58f78a2ec0 20 remove_watcher() i=6 2019-12-11T13:48:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:48:16.487+0000 7f58f78a2ec0 20 remove_watcher() i=7 2019-12-11T13:48:16.446 INFO:tasks.ragweed:Configuring ragweed... 2019-12-11T13:48:16.447 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-12-11T13:48:22.461 INFO:teuthology.orchestra.run.smithi073.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-11T13:48:22.565 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T13:48:22.602 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T13:48:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T13:48:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T13:48:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T13:48:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T13:48:23.221 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T13:48:23.569 INFO:teuthology.orchestra.run.smithi073.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-12-11T13:48:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T13:48:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:48:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-12-11T13:48:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-12-11T13:48:24.455 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-12-11T13:48:24.487 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-12-11T13:48:24.488 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-12-11T13:48:24.491 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-12-11T13:48:24.492 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:48:24.492 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-12-11T13:48:24.494 INFO:teuthology.orchestra.run.smithi073.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-12-11T13:48:24.497 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-12-11T13:48:24.497 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T13:48:24.498 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-12-11T13:48:24.884 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T13:48:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:25.078 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T13:48:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout:Installing for dependencies: 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-12-11T13:48:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-12-11T13:48:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:25.081 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T13:48:25.081 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T13:48:25.081 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages (+3 Dependent packages) 2019-12-11T13:48:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:25.082 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.7 M 2019-12-11T13:48:25.082 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 12 M 2019-12-11T13:48:25.082 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T13:48:25.345 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2019-12-11T13:48:25.346 INFO:teuthology.orchestra.run.smithi073.stdout:Total 6.3 MB/s | 1.7 MB 00:00 2019-12-11T13:48:25.353 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T13:48:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T13:48:25.407 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T13:48:25.408 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T13:48:26.072 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-12-11T13:48:26.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-12-11T13:48:26.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-11T13:48:27.223 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-12-11T13:48:27.752 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-12-11T13:48:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-12-11T13:48:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-12-11T13:48:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-12-11T13:48:28.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-12-11T13:48:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-11T13:48:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-12-11T13:48:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-12-11T13:48:29.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-12-11T13:48:29.681 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-12-11T13:48:29.681 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout:Dependency Installed: 2019-12-11T13:48:29.682 INFO:teuthology.orchestra.run.smithi073.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-12-11T13:48:29.683 INFO:teuthology.orchestra.run.smithi073.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-12-11T13:48:29.683 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:29.683 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T13:48:29.923 INFO:teuthology.orchestra.run.smithi073.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-12-11T13:48:31.520 INFO:teuthology.orchestra.run.smithi073.stdout:Installing setuptools, pip, wheel...done. 2019-12-11T13:48:32.002 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting pip 2019-12-11T13:48:32.098 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-12-11T13:48:32.356 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: pip 2019-12-11T13:48:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: pip 9.0.1 2019-12-11T13:48:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling pip-9.0.1: 2019-12-11T13:48:32.528 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled pip-9.0.1 2019-12-11T13:48:33.345 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed pip-19.3.1 2019-12-11T13:48:34.109 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T13:48:34.166 INFO:teuthology.orchestra.run.smithi073.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-12-11T13:48:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T13:48:35.196 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting nose 2019-12-11T13:48:35.247 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-12-11T13:48:35.361 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: nose 2019-12-11T13:48:35.435 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed nose-1.3.7 2019-12-11T13:48:35.988 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T13:48:36.559 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting setuptools==32.3.1 2019-12-11T13:48:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-12-11T13:48:36.819 INFO:teuthology.orchestra.run.smithi073.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-11T13:48:36.819 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: setuptools 2019-12-11T13:48:36.820 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: setuptools 28.8.0 2019-12-11T13:48:36.836 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling setuptools-28.8.0: 2019-12-11T13:48:36.847 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-11T13:48:36.976 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed setuptools-32.3.1 2019-12-11T13:48:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T13:48:37.822 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting PyYAML 2019-12-11T13:48:37.867 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/8d/c9/e5be955a117a1ac548cdd31e37e8fd7b02ce987f9655f5c7563c656d5dcb/PyYAML-5.2.tar.gz (265kB) 2019-12-11T13:48:38.469 INFO:teuthology.orchestra.run.smithi073.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-12-11T13:48:38.592 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-12-11T13:48:38.603 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-12-11T13:48:38.893 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting bunch>=1.0.0 2019-12-11T13:48:38.903 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-12-11T13:48:39.534 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting gevent>=1.0 2019-12-11T13:48:39.552 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-12-11T13:48:39.969 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting httplib2 2019-12-11T13:48:39.980 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-12-11T13:48:41.215 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting lxml 2019-12-11T13:48:41.230 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-12-11T13:48:41.701 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-11T13:48:41.711 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T13:48:41.838 INFO:teuthology.orchestra.run.smithi073.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-12-11T13:48:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for PyYAML (setup.py): started 2019-12-11T13:48:42.563 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-12-11T13:48:42.564 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for PyYAML: filename=PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl size=46299 sha256=ef957c92eb13fb1056e6d2674b901334a7e0e9cc27405071c790f53317e235d7 2019-12-11T13:48:42.564 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67 2019-12-11T13:48:42.581 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for bunch (setup.py): started 2019-12-11T13:48:42.897 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-12-11T13:48:42.897 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=cd0bbd70223c739605bd9e284a6df8f3dc6463346311151cca676c0ef7a088ef 2019-12-11T13:48:42.897 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-12-11T13:48:42.902 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for httplib2 (setup.py): started 2019-12-11T13:48:43.215 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-12-11T13:48:43.216 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=c0fe952974eb16c9f71f97668a53739c367636edd569fb17d7456c9d4e447a0d 2019-12-11T13:48:43.216 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-12-11T13:48:43.222 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully built PyYAML bunch httplib2 2019-12-11T13:48:43.330 INFO:teuthology.orchestra.run.smithi073.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-11T13:48:43.331 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-12-11T13:48:43.331 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: PyYAML 3.10 2019-12-11T13:48:43.331 INFO:teuthology.orchestra.run.smithi073.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-11T13:48:43.331 INFO:teuthology.orchestra.run.smithi073.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-12-11T13:48:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: lxml 3.2.1 2019-12-11T13:48:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-11T13:48:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-12-11T13:48:44.462 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-12-11T13:48:44.840 INFO:teuthology.orchestra.run.smithi073.stdout:running develop 2019-12-11T13:48:44.903 INFO:teuthology.orchestra.run.smithi073.stdout:running egg_info 2019-12-11T13:48:44.903 INFO:teuthology.orchestra.run.smithi073.stdout:creating ragweed.egg-info 2019-12-11T13:48:44.903 INFO:teuthology.orchestra.run.smithi073.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-12-11T13:48:44.903 INFO:teuthology.orchestra.run.smithi073.stdout:writing ragweed.egg-info/PKG-INFO 2019-12-11T13:48:44.904 INFO:teuthology.orchestra.run.smithi073.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-12-11T13:48:44.904 INFO:teuthology.orchestra.run.smithi073.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-12-11T13:48:44.904 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-11T13:48:44.904 INFO:teuthology.orchestra.run.smithi073.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-11T13:48:44.905 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-11T13:48:44.916 INFO:teuthology.orchestra.run.smithi073.stdout:running build_ext 2019-12-11T13:48:44.916 INFO:teuthology.orchestra.run.smithi073.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-12-11T13:48:44.916 INFO:teuthology.orchestra.run.smithi073.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-12-11T13:48:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:44.916 INFO:teuthology.orchestra.run.smithi073.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-12-11T13:48:44.917 INFO:teuthology.orchestra.run.smithi073.stdout:Processing dependencies for ragweed==0.0.1 2019-12-11T13:48:44.917 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for isodate>=0.4.4 2019-12-11T13:48:44.917 INFO:teuthology.orchestra.run.smithi073.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-12-11T13:48:45.009 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-12-11T13:48:45.061 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: isodate 0.6.0 2019-12-11T13:48:45.061 INFO:teuthology.orchestra.run.smithi073.stdout:Processing isodate-0.6.0.tar.gz 2019-12-11T13:48:45.065 INFO:teuthology.orchestra.run.smithi073.stdout:Writing /tmp/easy_install-mUeECD/isodate-0.6.0/setup.cfg 2019-12-11T13:48:45.066 INFO:teuthology.orchestra.run.smithi073.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-mUeECD/isodate-0.6.0/egg-dist-tmp-E6k3Hy 2019-12-11T13:48:45.367 INFO:teuthology.orchestra.run.smithi073.stderr:zip_safe flag not set; analyzing archive contents... 2019-12-11T13:48:45.381 INFO:teuthology.orchestra.run.smithi073.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.383 INFO:teuthology.orchestra.run.smithi073.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-11T13:48:45.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.384 INFO:teuthology.orchestra.run.smithi073.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-12-11T13:48:45.411 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for gevent==1.4.0 2019-12-11T13:48:45.411 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: gevent 1.4.0 2019-12-11T13:48:45.411 INFO:teuthology.orchestra.run.smithi073.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-11T13:48:45.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.413 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.413 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for bunch==1.0.1 2019-12-11T13:48:45.414 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: bunch 1.0.1 2019-12-11T13:48:45.414 INFO:teuthology.orchestra.run.smithi073.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-11T13:48:45.414 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.414 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for PyYAML==5.2 2019-12-11T13:48:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: PyYAML 5.2 2019-12-11T13:48:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-11T13:48:45.415 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.416 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.418 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for boto==2.49.0 2019-12-11T13:48:45.418 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: boto 2.49.0 2019-12-11T13:48:45.419 INFO:teuthology.orchestra.run.smithi073.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-11T13:48:45.419 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.419 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.419 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for six==1.9.0 2019-12-11T13:48:45.420 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: six 1.9.0 2019-12-11T13:48:45.420 INFO:teuthology.orchestra.run.smithi073.stdout:Adding six 1.9.0 to easy-install.pth file 2019-12-11T13:48:45.420 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.420 INFO:teuthology.orchestra.run.smithi073.stdout:Using /usr/lib/python2.7/site-packages 2019-12-11T13:48:45.424 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for greenlet==0.4.15 2019-12-11T13:48:45.425 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: greenlet 0.4.15 2019-12-11T13:48:45.425 INFO:teuthology.orchestra.run.smithi073.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-11T13:48:45.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:48:45.425 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-11T13:48:45.426 INFO:teuthology.orchestra.run.smithi073.stdout:Finished processing dependencies for ragweed==0.0.1 2019-12-11T13:48:45.441 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-12-11T13:48:45.489 INFO:tasks.ragweed:Configuring boto... 2019-12-11T13:48:45.489 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-11T13:48:45.577 INFO:teuthology.orchestra.run.smithi073:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-12-11T13:49:16.405 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-12-11T13:49:45.966 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-12-11T13:50:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-12-11T13:50:27.054 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-12-11T13:50:54.213 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-12-11T13:51:11.571 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:09:11.758 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:11.641 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:09:11.828 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:11.653 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:11.841 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:11.702 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:11.889 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:11.714 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:09:11.903 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:11.788 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:09:11.978 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:12.241 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:09:12.429 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:12.311 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:12.499 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:51:12.417 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:09:12.607 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:52:05.826 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-12-11T13:52:57.505 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-12-11T13:53:33.757 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:11:33.960 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.769 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:11:33.966 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.774 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:33.977 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.777 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:33.980 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.781 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:11:33.974 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.787 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:11:33.979 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.867 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:11:34.070 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.884 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:11:34.087 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:53:33.903 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:11:34.096 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:54:52.852 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-12-11T13:55:21.426 INFO:teuthology.orchestra.run.smithi073.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-12-11T13:55:21.429 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T13:55:21.429 INFO:teuthology.orchestra.run.smithi073.stderr:---------------------------------------------------------------------- 2019-12-11T13:55:21.429 INFO:teuthology.orchestra.run.smithi073.stderr:Ran 9 tests in 395.495s 2019-12-11T13:55:21.429 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T13:55:21.429 INFO:teuthology.orchestra.run.smithi073.stderr:OK 2019-12-11T13:55:21.458 INFO:tasks.ragweed:Cleaning up boto... 2019-12-11T13:55:21.458 INFO:teuthology.orchestra.run.smithi073:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-11T13:55:21.524 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-12-11T13:55:21.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.742+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.773+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.773+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.784+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.784+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.790+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.790+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.797+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:21.885 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.981+0000 7f9d63afeec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:55:21.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.981+0000 7f9d63afeec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:55:21.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.981+0000 7f9d63afeec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:55:21.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.981+0000 7f9d63afeec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:55:21.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.981+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.893 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.988+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:21.893 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.988+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.999+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:55:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:21.999+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.005+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.005+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.014+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:55:21.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.014+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.021+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.021+0000 7f9d63afeec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:55:21.926 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.021+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.028+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.028+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.035+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:21.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.035+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.950 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.045+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:55:21.950 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.045+0000 7f9d63afeec0 20 zonegroup default 2019-12-11T13:55:21.951 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.045+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.957 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.053+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.957 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.053+0000 7f9d63afeec0 10 Cannot find current period zone using local zone 2019-12-11T13:55:21.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.053+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.059+0000 7f9d63afeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:21.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.059+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.974 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.069+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:21.974 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.070+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:21.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.090+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:55:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.090+0000 7f9d63afeec0 20 zone default found 2019-12-11T13:55:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.090+0000 7f9d63afeec0 20 started sync module instance, tier type = 2019-12-11T13:55:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.090+0000 7f9d63afeec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:55:22.437 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=0 2019-12-11T13:55:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=1 2019-12-11T13:55:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=2 2019-12-11T13:55:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=3 2019-12-11T13:55:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=4 2019-12-11T13:55:22.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.533+0000 7f9d63afeec0 20 add_watcher() i=5 2019-12-11T13:55:22.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.561+0000 7f9d63afeec0 20 add_watcher() i=6 2019-12-11T13:55:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.568+0000 7f9d63afeec0 20 add_watcher() i=7 2019-12-11T13:55:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.568+0000 7f9d63afeec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:55:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.568+0000 7f9d20fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:55:22.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.580+0000 7f9d4bfff700 0 -- 172.21.15.73:0/2742867883 >> v2:172.21.15.73:3300/0 conn(0x5615e5de1f20 msgr2=0x5615e5de4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T13:55:22.513 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:22.608+0000 7f9d4bfff700 0 -- 172.21.15.73:0/2969837928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5615e5de80e0 msgr2=0x5615e5dea5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T13:55:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9c92ffd700 20 reqs_thread_entry: start 2019-12-11T13:55:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9c90ff9700 20 reqs_thread_entry: start 2019-12-11T13:55:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9d63afeec0 20 init_complete bucket index max shards: 0 2019-12-11T13:55:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9c86ffd700 20 reqs_thread_entry: start 2019-12-11T13:55:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9d63afeec0 20 get_system_obj_state: rctx=0x7ffd920e6768 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5615e5e5cf20 s->prefetch_data=0 2019-12-11T13:55:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.215+0000 7f9d63afeec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T13:55:24.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.228+0000 7f9d63afeec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:24.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.244+0000 7f9d63afeec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-11T13:55:24.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.244+0000 7f9d63afeec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-12-11T13:55:24.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.244+0000 7f9d63afeec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-11T13:55:24.164 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.258+0000 7f9d63afeec0 10 removing key index: RBQHVWTMYRDZXJIYJYGQ 2019-12-11T13:55:24.164 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.258+0000 7f9d63afeec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-11T13:55:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.266+0000 7f9d39ffb700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94652050739456 notifier 4469 bl.length()=170 2019-12-11T13:55:24.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.466+0000 7f9d63afeec0 10 removing email index: sysuser.client.0+test@test.test 2019-12-11T13:55:24.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.466+0000 7f9d63afeec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-12-11T13:55:24.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.478+0000 7f9d39ffb700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94652050737408 notifier 4469 bl.length()=182 2019-12-11T13:55:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.809+0000 7f9d63afeec0 10 removing user buckets index 2019-12-11T13:55:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.809+0000 7f9d63afeec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-12-11T13:55:24.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:24.825+0000 7f9d39ffb700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94652050721616 notifier 4469 bl.length()=173 2019-12-11T13:55:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.249+0000 7f9d63afeec0 10 removing user index: sysuser.client.0 2019-12-11T13:55:25.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.249+0000 7f9d63afeec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-12-11T13:55:25.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.249+0000 7f9d63afeec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-12-11T13:55:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.268+0000 7f9d39ffb700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94652050720048 notifier 4469 bl.length()=165 2019-12-11T13:55:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.429+0000 7f9d63afeec0 20 remove_watcher() i=0 2019-12-11T13:55:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.429+0000 7f9d63afeec0 2 removed watcher, disabling cache 2019-12-11T13:55:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.465+0000 7f9d63afeec0 20 remove_watcher() i=1 2019-12-11T13:55:25.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.509+0000 7f9d63afeec0 20 remove_watcher() i=2 2019-12-11T13:55:25.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.541+0000 7f9d63afeec0 20 remove_watcher() i=3 2019-12-11T13:55:25.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.570+0000 7f9d63afeec0 20 remove_watcher() i=4 2019-12-11T13:55:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.602+0000 7f9d63afeec0 20 remove_watcher() i=5 2019-12-11T13:55:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.636+0000 7f9d63afeec0 20 remove_watcher() i=6 2019-12-11T13:55:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.683+0000 7f9d63afeec0 20 remove_watcher() i=7 2019-12-11T13:55:25.596 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-12-11T13:55:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.823+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.851+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.851+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.860+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.860+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.865+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.865+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.871+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.990+0000 7fd6cb268ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:55:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.990+0000 7fd6cb268ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:55:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.990+0000 7fd6cb268ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:55:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.990+0000 7fd6cb268ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:55:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.990+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.902 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.998+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:25.902 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:25.998+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.010+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:55:25.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.011+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.018+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:25.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.018+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.026+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:55:25.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.026+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.035+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.035+0000 7fd6cb268ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:55:25.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.035+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.945 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.041+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.945 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.041+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.048+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.048+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.057+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.057+0000 7fd6cb268ec0 20 zonegroup default 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.057+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.062+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.062+0000 7fd6cb268ec0 10 Cannot find current period zone using local zone 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.062+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.067+0000 7fd6cb268ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:55:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.067+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.982 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.073+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:55:25.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.074+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:25.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.087+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:55:25.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.087+0000 7fd6cb268ec0 20 zone default found 2019-12-11T13:55:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.087+0000 7fd6cb268ec0 20 started sync module instance, tier type = 2019-12-11T13:55:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.087+0000 7fd6cb268ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:55:26.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=0 2019-12-11T13:55:26.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=1 2019-12-11T13:55:26.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=2 2019-12-11T13:55:26.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=3 2019-12-11T13:55:26.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=4 2019-12-11T13:55:26.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=5 2019-12-11T13:55:26.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.499+0000 7fd6cb268ec0 20 add_watcher() i=6 2019-12-11T13:55:26.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.535+0000 7fd6b8492700 0 -- 172.21.15.73:0/2934203188 >> [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] conn(0x55e0ca9ace00 msgr2=0x55e0ca9af2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:55:26.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.535+0000 7fd6cb268ec0 20 add_watcher() i=7 2019-12-11T13:55:26.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.535+0000 7fd6cb268ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:55:26.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.535+0000 7fd688fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:55:26.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.556+0000 7fd6b8c93700 0 -- 172.21.15.73:0/541195091 >> v2:172.21.15.73:3300/0 conn(0x55e0ca9bf0a0 msgr2=0x55e0ca9bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:55:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:26.758+0000 7fd6b8c93700 0 --2- 172.21.15.73:0/541195091 >> v2:172.21.15.73:3300/0 conn(0x55e0ca9bf0a0 0x55e0ca9bf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T13:55:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd5faffd700 20 reqs_thread_entry: start 2019-12-11T13:55:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd5f8ff9700 20 reqs_thread_entry: start 2019-12-11T13:55:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd6cb268ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:55:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd5eeffd700 20 reqs_thread_entry: start 2019-12-11T13:55:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84cd8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55e0caa3dff0 s->prefetch_data=0 2019-12-11T13:55:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.267+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T13:55:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.276+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:28.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.287+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-11T13:55:28.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.287+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-12-11T13:55:28.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.287+0000 7fd6cb268ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-11T13:55:28.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.314+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-conf state=0x55e0caa3f910 s->prefetch_data=0 2019-12-11T13:55:28.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.314+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-12-11T13:55:28.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-12-11T13:55:28.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-11T13:55:28.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:28.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:28.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:28.228 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.323+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:28.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.334+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=200 2019-12-11T13:55:28.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.334+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-12-11T13:55:28.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.334+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-11T13:55:28.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.334+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 state=0x55e0caa41ef0 s->prefetch_data=0 2019-12-11T13:55:28.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.334+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 : miss 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 info.flags=0x16 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 to cache LRU end 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:28.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:28.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:28.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:28.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.357+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:28.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=292 2019-12-11T13:55:28.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 info.flags=0x13 2019-12-11T13:55:28.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 to cache LRU end 2019-12-11T13:55:28.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:28.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:28.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.374+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:28.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.385+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-conf[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1]) start [] num_entries 1100 2019-12-11T13:55:28.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-12-11T13:55:28.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-12-11T13:55:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-12-11T13:55:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.404+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.420+0000 7fd6cb268ec0 10 manifest: total_size = 5933 2019-12-11T13:55:28.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.420+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.13 2019-12-11T13:55:28.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.421+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.421+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:28.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.421+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.534+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.574+0000 7fd6cb268ec0 10 manifest: total_size = 3885 2019-12-11T13:55:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.574+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.30 2019-12-11T13:55:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.574+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.574+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:28.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.574+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.665+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.685+0000 7fd6cb268ec0 10 manifest: total_size = 3782 2019-12-11T13:55:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.685+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.56 2019-12-11T13:55:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.685+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.685+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.685+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:28.748 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.844+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.857+0000 7fd6cb268ec0 10 manifest: total_size = 5804 2019-12-11T13:55:28.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.857+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.72 2019-12-11T13:55:28.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.857+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.857+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:28.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.857+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:28.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.978+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.890 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.986+0000 7fd6cb268ec0 10 manifest: total_size = 5958 2019-12-11T13:55:28.890 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.986+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.87 2019-12-11T13:55:28.890 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.986+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:28.891 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.986+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:28.891 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:28.986+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:29.038 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.133+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.148+0000 7fd6cb268ec0 10 manifest: total_size = 6046 2019-12-11T13:55:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.148+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.120 2019-12-11T13:55:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.148+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.148+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.148+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:29.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.316+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:29.228 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.325+0000 7fd6cb268ec0 10 manifest: total_size = 4115 2019-12-11T13:55:29.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.325+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.190 2019-12-11T13:55:29.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.325+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e0caa470d8 s->prefetch_data=0 2019-12-11T13:55:29.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.325+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa470d8 2019-12-11T13:55:29.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.325+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:29.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.451+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e0caa4dad8 s->prefetch_data=0 2019-12-11T13:55:29.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.472+0000 7fd6cb268ec0 10 manifest: total_size = 4025 2019-12-11T13:55:29.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.472+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.247 2019-12-11T13:55:29.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.472+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e0caa4dad8 s->prefetch_data=0 2019-12-11T13:55:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.472+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa4dad8 2019-12-11T13:55:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.472+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:29.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.594+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e0caa4dad8 s->prefetch_data=0 2019-12-11T13:55:29.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.631+0000 7fd6cb268ec0 10 manifest: total_size = 4231 2019-12-11T13:55:29.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.631+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.323 2019-12-11T13:55:29.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.631+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e0caa4dad8 s->prefetch_data=0 2019-12-11T13:55:29.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.631+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa4dad8 2019-12-11T13:55:29.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.631+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 2019-12-11T13:55:29.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.745+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-conf[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1]) start _multipart_[] num_entries 1001 2019-12-11T13:55:29.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.745+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:29.702 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.798+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.861+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-conf state=0x55e0caa46d90 s->prefetch_data=0 2019-12-11T13:55:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.861+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-12-11T13:55:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-11T13:55:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:29.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:29.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:29.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-12-11T13:55:29.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.871+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-12-11T13:55:29.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:29.905+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781184 cookie 94423960146176 notifier 4678 bl.length()=162 2019-12-11T13:55:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:30.776+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.1 from cache 2019-12-11T13:55:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:30.776+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=219 2019-12-11T13:55:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:30.794+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94423960175696 notifier 4678 bl.length()=219 2019-12-11T13:55:31.107 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.203+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55e0caa46d90 s->prefetch_data=0 2019-12-11T13:55:31.108 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.203+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-12-11T13:55:31.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-12-11T13:55:31.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-11T13:55:31.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:31.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:31.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:31.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.218+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.240+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=229 2019-12-11T13:55:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.240+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-12-11T13:55:31.145 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.240+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-11T13:55:31.145 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.240+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:31.145 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.240+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 : miss 2019-12-11T13:55:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 info.flags=0x16 2019-12-11T13:55:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 to cache LRU end 2019-12-11T13:55:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.260+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=321 2019-12-11T13:55:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 info.flags=0x13 2019-12-11T13:55:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 to cache LRU end 2019-12-11T13:55:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.288+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 2019-12-11T13:55:31.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.306+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2]) start [] num_entries 1100 2019-12-11T13:55:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.326+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-11T13:55:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.326+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e0caa47048 s->prefetch_data=0 2019-12-11T13:55:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.339+0000 7fd6cb268ec0 10 manifest: total_size = 26081 2019-12-11T13:55:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.339+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.20 2019-12-11T13:55:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.339+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e0caa47048 s->prefetch_data=0 2019-12-11T13:55:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.339+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa47048 2019-12-11T13:55:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.339+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 2019-12-11T13:55:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2019-12-11T13:55:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7674 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7674 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7670 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2019-12-11T13:55:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=7670 2019-12-11T13:55:31.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2019-12-11T13:55:31.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2019-12-11T13:55:31.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4217318 part_ofs=23014 rule->part_size=3067 2019-12-11T13:55:31.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2019-12-11T13:55:31.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.443+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.20 2019-12-11T13:55:31.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.577+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2]) start _multipart_[] num_entries 1001 2019-12-11T13:55:31.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.577+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:31.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.588+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:31.581 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.677+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55e0caa48280 s->prefetch_data=0 2019-12-11T13:55:31.581 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.677+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:31.599 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-12-11T13:55:31.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.695+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-12-11T13:55:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:31.730+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781184 cookie 94423960148224 notifier 4678 bl.length()=191 2019-12-11T13:55:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.089+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2 from cache 2019-12-11T13:55:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.089+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=248 2019-12-11T13:55:32.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.103+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94423960152000 notifier 4678 bl.length()=248 2019-12-11T13:55:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.365+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.365+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-12-11T13:55:32.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-12-11T13:55:32.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-11T13:55:32.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:32.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:32.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:32.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.378+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:32.294 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.391+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=236 2019-12-11T13:55:32.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.391+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-12-11T13:55:32.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.391+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-11T13:55:32.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.391+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 state=0x55e0caa46d90 s->prefetch_data=0 2019-12-11T13:55:32.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.391+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 : miss 2019-12-11T13:55:32.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 info.flags=0x16 2019-12-11T13:55:32.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 to cache LRU end 2019-12-11T13:55:32.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:32.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:32.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:32.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:32.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:32.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:32.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.405+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=328 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 info.flags=0x13 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 to cache LRU end 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:32.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.436+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 2019-12-11T13:55:32.356 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.453+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3]) start [] num_entries 1100 2019-12-11T13:55:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.489+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-11T13:55:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.489+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e0caa47048 s->prefetch_data=0 2019-12-11T13:55:32.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.501+0000 7fd6cb268ec0 10 manifest: total_size = 18874368 2019-12-11T13:55:32.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.501+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.40 2019-12-11T13:55:32.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.501+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e0caa47048 s->prefetch_data=0 2019-12-11T13:55:32.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.501+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa47048 2019-12-11T13:55:32.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.501+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 2019-12-11T13:55:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-12-11T13:55:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-12-11T13:55:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.626+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.40 2019-12-11T13:55:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.730+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3]) start _multipart_[] num_entries 1001 2019-12-11T13:55:32.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.730+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:32.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.751+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:32.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.830+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:32.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.830+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:32.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-12-11T13:55:32.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-11T13:55:32.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:32.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:32.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:32.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-12-11T13:55:32.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.848+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-12-11T13:55:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:32.863+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781190 cookie 94423960152000 notifier 4678 bl.length()=198 2019-12-11T13:55:33.388 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.484+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3 from cache 2019-12-11T13:55:33.388 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.484+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=255 2019-12-11T13:55:33.402 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.499+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94423960148224 notifier 4678 bl.length()=255 2019-12-11T13:55:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.687+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.687+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-12-11T13:55:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-12-11T13:55:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-11T13:55:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.697+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.707+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=231 2019-12-11T13:55:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.707+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-12-11T13:55:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.707+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-11T13:55:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.707+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 state=0x55e0caa46d90 s->prefetch_data=0 2019-12-11T13:55:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.707+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 : miss 2019-12-11T13:55:33.620 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 info.flags=0x16 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 to cache LRU end 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.717+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:33.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=323 2019-12-11T13:55:33.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 info.flags=0x13 2019-12-11T13:55:33.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 to cache LRU end 2019-12-11T13:55:33.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.730+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.743+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4]) start [] num_entries 1100 2019-12-11T13:55:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.766+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo[sLsrtQPfkbUQsaaImFiPBQ69EB41Ix3] 2019-12-11T13:55:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.766+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.779+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.791+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to q0f2fmxf7cx99mdsy0oouifa7xo8ztr4 2019-12-11T13:55:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.791+0000 7fd6cb268ec0 20 get_obj_state_impl: setting s->olh_tag to qjhprd7ulbrv50knayb52hn321l4x24q 2019-12-11T13:55:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.791+0000 7fd6cb268ec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qjhprd7ulbrv50knayb52hn321l4x24q 2019-12-11T13:55:33.757 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.846+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.928+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.928+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.952+0000 7fd6cb268ec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-12-11T13:55:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.952+0000 7fd6cb268ec0 20 olh_log_entry: epoch=3 op=3 key=foo[sLsrtQPfkbUQsaaImFiPBQ69EB41Ix3] 2019-12-11T13:55:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.952+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-index-versioning.1:_:sLsrtQPfkbUQsaaImFiPBQ69EB41Ix3_foo state=0x55e0caa51b18 s->prefetch_data=0 2019-12-11T13:55:33.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.965+0000 7fd6cb268ec0 10 manifest: total_size = 74198 2019-12-11T13:55:33.870 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.965+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.55 2019-12-11T13:55:33.870 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.965+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-index-versioning.1:_:sLsrtQPfkbUQsaaImFiPBQ69EB41Ix3_foo state=0x55e0caa51b18 s->prefetch_data=0 2019-12-11T13:55:33.870 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.965+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa51b18 2019-12-11T13:55:33.870 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:33.965+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-12-11T13:55:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-12-11T13:55:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.085+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.55 2019-12-11T13:55:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.238+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.238+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:34.264 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.360+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:34.361 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.452+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 2019-12-11T13:55:34.361 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.452+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4]) start _multipart_[] num_entries 1001 2019-12-11T13:55:34.361 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.452+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:34.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.468+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.545+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55e0caa46d90 s->prefetch_data=0 2019-12-11T13:55:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.545+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-12-11T13:55:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-11T13:55:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-12-11T13:55:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.564+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-12-11T13:55:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.579+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781191 cookie 94423960152000 notifier 4678 bl.length()=193 2019-12-11T13:55:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.744+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4 from cache 2019-12-11T13:55:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.744+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=250 2019-12-11T13:55:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:34.758+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94423960154064 notifier 4678 bl.length()=250 2019-12-11T13:55:35.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.139+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:35.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.139+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-12-11T13:55:35.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-12-11T13:55:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-11T13:55:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.165+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:35.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.185+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-11T13:55:35.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.185+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-12-11T13:55:35.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.185+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-11T13:55:35.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.185+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:35.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.185+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 : miss 2019-12-11T13:55:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 info.flags=0x16 2019-12-11T13:55:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 to cache LRU end 2019-12-11T13:55:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.207+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.208+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:35.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-11T13:55:35.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 info.flags=0x13 2019-12-11T13:55:35.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 to cache LRU end 2019-12-11T13:55:35.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:35.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:35.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.230+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 2019-12-11T13:55:35.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.256+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5]) start [] num_entries 1100 2019-12-11T13:55:35.200 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.296+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-11T13:55:35.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.296+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.317+0000 7fd6cb268ec0 10 manifest: total_size = 1848 2019-12-11T13:55:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.317+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.71 2019-12-11T13:55:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.317+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.317+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48628 2019-12-11T13:55:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.317+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 2019-12-11T13:55:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-11T13:55:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-11T13:55:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-12-11T13:55:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-11T13:55:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-11T13:55:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-12-11T13:55:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-11T13:55:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.439+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.71 2019-12-11T13:55:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.528+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5]) start _multipart_[] num_entries 1001 2019-12-11T13:55:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.528+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:35.445 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.541+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.622+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55e0caa48280 s->prefetch_data=0 2019-12-11T13:55:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.622+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-12-11T13:55:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.631+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-12-11T13:55:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.640+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94423960169728 notifier 4678 bl.length()=183 2019-12-11T13:55:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.931+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5 from cache 2019-12-11T13:55:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.931+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=240 2019-12-11T13:55:35.847 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:35.943+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781192 cookie 94423960172096 notifier 4678 bl.length()=240 2019-12-11T13:55:36.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.421+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55e0caa46a50 s->prefetch_data=0 2019-12-11T13:55:36.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.421+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-12-11T13:55:36.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-12-11T13:55:36.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-11T13:55:36.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:36.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:36.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:36.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.429+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.439+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=227 2019-12-11T13:55:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.439+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-12-11T13:55:36.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.439+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-11T13:55:36.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.439+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:36.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.439+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 : miss 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 info.flags=0x16 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 to cache LRU end 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:36.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:36.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:36.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.470+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:36.422 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=319 2019-12-11T13:55:36.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 info.flags=0x13 2019-12-11T13:55:36.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 to cache LRU end 2019-12-11T13:55:36.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:36.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:36.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.518+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.530+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7]) start [] num_entries 1100 2019-12-11T13:55:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-11T13:55:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-11T13:55:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-11T13:55:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-11T13:55:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-11T13:55:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-11T13:55:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-11T13:55:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-11T13:55:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-11T13:55:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-11T13:55:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-11T13:55:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-11T13:55:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.554+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.564+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.564+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.108 2019-12-11T13:55:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.564+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.564+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48628 2019-12-11T13:55:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.564+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:36.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.650+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.650+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.650+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.650+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.650+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.108 2019-12-11T13:55:36.624 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.721+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.733+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.733+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.109 2019-12-11T13:55:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.733+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.733+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48628 2019-12-11T13:55:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.733+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.815+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.815+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.815+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.815+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.815+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.109 2019-12-11T13:55:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.871+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.891+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:36.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.891+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _z8FHvC-1gHhKbZP_0afYRe6mjqXWHNl 2019-12-11T13:55:36.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.891+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:36.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.891+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48628 2019-12-11T13:55:36.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:36.891+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.012+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.012+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.012+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.012+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.012+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _z8FHvC-1gHhKbZP_0afYRe6mjqXWHNl 2019-12-11T13:55:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.097+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:37.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.108+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:37.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.108+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _jBMLDECzP2lMaEnzSF4ZX8jItQzbnRu 2019-12-11T13:55:37.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.108+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e0caa48628 s->prefetch_data=0 2019-12-11T13:55:37.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.108+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48628 2019-12-11T13:55:37.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.108+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.296+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.296+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.296+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _jBMLDECzP2lMaEnzSF4ZX8jItQzbnRu 2019-12-11T13:55:37.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.378+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.292 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.389+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:37.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.389+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.112 2019-12-11T13:55:37.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.389+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.389+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:37.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.389+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:37.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.476+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.476+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.476+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.476+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.476+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.112 2019-12-11T13:55:37.453 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.547+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.571+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.571+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _YVsoYWBZ5cAl6ocyhhcNZxrU9FGWMRQ 2019-12-11T13:55:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.571+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.571+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.571+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:37.641 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.738+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.641 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.738+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.642 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.738+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.642 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.738+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.642 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.738+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _YVsoYWBZ5cAl6ocyhhcNZxrU9FGWMRQ 2019-12-11T13:55:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.805+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.815+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:37.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.815+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.114 2019-12-11T13:55:37.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.815+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.815+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:37.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.815+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:37.818 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.915+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.915+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.915+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:37.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.915+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:37.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:37.915+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.114 2019-12-11T13:55:37.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.040+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.072+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.072+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _Socpn7x0LK7yU8aMQCv1Muz9N_x1f6H 2019-12-11T13:55:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.072+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.072+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.072+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:38.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.375+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:38.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.375+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:38.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.375+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _Socpn7x0LK7yU8aMQCv1Muz9N_x1f6H 2019-12-11T13:55:38.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.452+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.465+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.465+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.116 2019-12-11T13:55:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.465+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.465+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.465+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:38.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.695+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:38.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.695+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:38.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.695+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.116 2019-12-11T13:55:38.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.822+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.838+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.838+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _10eI677Bd_YJOx7LeSjQbjmc1BDP2pr 2019-12-11T13:55:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.838+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.838+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:38.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.838+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:38.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.947+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:38.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.947+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:38.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.947+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:38.851 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.947+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:38.851 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:38.947+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _10eI677Bd_YJOx7LeSjQbjmc1BDP2pr 2019-12-11T13:55:38.910 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.007+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.016+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.016+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _4dYskbX_ST2d-NL9Jmy6gH23f_BFGrL 2019-12-11T13:55:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.016+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:38.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.016+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:38.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.016+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:39.022 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.119+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:39.022 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.119+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:39.022 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.119+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:39.022 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.119+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:39.022 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.119+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _4dYskbX_ST2d-NL9Jmy6gH23f_BFGrL 2019-12-11T13:55:39.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.226+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.235+0000 7fd6cb268ec0 10 manifest: total_size = 5242880 2019-12-11T13:55:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.235+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.119 2019-12-11T13:55:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.235+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.235+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.235+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 2019-12-11T13:55:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.420+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.420+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-11T13:55:39.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.420+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.119 2019-12-11T13:55:39.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.490+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7]) start _multipart_[] num_entries 1001 2019-12-11T13:55:39.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.490+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:39.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.500+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.594+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55e0caa46ff0 s->prefetch_data=0 2019-12-11T13:55:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.594+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:39.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-12-11T13:55:39.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-11T13:55:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-12-11T13:55:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.606+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-12-11T13:55:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.615+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781193 cookie 94423960152000 notifier 4678 bl.length()=189 2019-12-11T13:55:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.942+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7 from cache 2019-12-11T13:55:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.942+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=246 2019-12-11T13:55:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:39.958+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94423960154064 notifier 4678 bl.length()=246 2019-12-11T13:55:40.592 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.690+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55e0caa46ff0 s->prefetch_data=0 2019-12-11T13:55:40.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.690+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-12-11T13:55:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-12-11T13:55:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-11T13:55:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.704+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.719+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=237 2019-12-11T13:55:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.719+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-12-11T13:55:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.719+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-11T13:55:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.719+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.719+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 : miss 2019-12-11T13:55:40.647 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 info.flags=0x16 2019-12-11T13:55:40.647 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 to cache LRU end 2019-12-11T13:55:40.647 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:40.647 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:40.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:40.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:40.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:40.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:40.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.744+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:40.677 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=329 2019-12-11T13:55:40.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 info.flags=0x13 2019-12-11T13:55:40.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 to cache LRU end 2019-12-11T13:55:40.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:40.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:40.678 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.775+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:40.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.796+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9]) start [] num_entries 1100 2019-12-11T13:55:40.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-11T13:55:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-11T13:55:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-11T13:55:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-11T13:55:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-11T13:55:40.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-11T13:55:40.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-11T13:55:40.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-11T13:55:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-11T13:55:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-11T13:55:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-11T13:55:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-11T13:55:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.835+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:40.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.857+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:40.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.857+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.225 2019-12-11T13:55:40.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.857+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.857+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.857+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:40.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:40.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:40.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:40.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:40.978+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.225 2019-12-11T13:55:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.036+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:40.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.045+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:40.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.045+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.226 2019-12-11T13:55:40.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.045+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:40.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.045+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:40.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.045+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.067 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.165+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.226 2019-12-11T13:55:41.117 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.214+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.235+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.235+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _FkmhGsJE479SM28Rxji93_eunsbZUvb 2019-12-11T13:55:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.235+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.235+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.236+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.335+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.336+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _FkmhGsJE479SM28Rxji93_eunsbZUvb 2019-12-11T13:55:41.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.414+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.423+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.423+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _JPN63QpTBXql8diPG-9oE8JCenUr_vI 2019-12-11T13:55:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.423+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.423+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.423+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.591+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.591+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.591+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.591+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.591+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _JPN63QpTBXql8diPG-9oE8JCenUr_vI 2019-12-11T13:55:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.626+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.634+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.634+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.234 2019-12-11T13:55:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.634+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.634+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.634+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.608 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.608 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.608 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:41.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:41.611 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.705+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.234 2019-12-11T13:55:41.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.770+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.780+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.780+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _bGsLqT50HWpP7Dm9yLxXw5grF2MlOO5 2019-12-11T13:55:41.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.780+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.780+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.780+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:41.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:41.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.851+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _bGsLqT50HWpP7Dm9yLxXw5grF2MlOO5 2019-12-11T13:55:41.801 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.898+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.907+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.907+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.236 2019-12-11T13:55:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.907+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.907+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.907+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:41.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:41.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:41.971+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.236 2019-12-11T13:55:41.933 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.031+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.040+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:41.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.040+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _xXzpp6Ir-ZX_CZF1Y6E-Fm2aNYrxI0I 2019-12-11T13:55:41.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.040+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:41.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.040+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:41.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.040+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:42.109 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.207+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.109 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.207+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.109 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.207+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.110 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.207+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.110 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.207+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _xXzpp6Ir-ZX_CZF1Y6E-Fm2aNYrxI0I 2019-12-11T13:55:42.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.307+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.219 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.317+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:42.219 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.317+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.243 2019-12-11T13:55:42.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.317+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.317+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:42.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.317+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:42.331 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:42.331 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:42.331 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.426+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.243 2019-12-11T13:55:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.511+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.527+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.527+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _20bvbbZL31ceEIiinOLTT0eR2tT2sPk 2019-12-11T13:55:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.527+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.527+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.527+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:42.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.636+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.637+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _20bvbbZL31ceEIiinOLTT0eR2tT2sPk 2019-12-11T13:55:42.640 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.738+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.749+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.749+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to _DGSRFgxc-AewVM7vWEKIddv-XBJLzAY 2019-12-11T13:55:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.749+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.749+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.749+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:42.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-11T13:55:42.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:42.898+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _DGSRFgxc-AewVM7vWEKIddv-XBJLzAY 2019-12-11T13:55:42.916 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.014+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.924 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.022+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.022+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.246 2019-12-11T13:55:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.022+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.022+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.022+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 2019-12-11T13:55:43.009 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:43.009 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:43.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:43.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:43.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:43.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:43.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:43.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:43.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:43.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:43.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.105+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.246 2019-12-11T13:55:43.274 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.372+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9]) start _multipart_[] num_entries 1001 2019-12-11T13:55:43.274 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.372+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:43.296 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.394+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:43.395 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.492+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55e0caa46ff0 s->prefetch_data=0 2019-12-11T13:55:43.395 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.492+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-12-11T13:55:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.512+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-12-11T13:55:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.530+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94423960154064 notifier 4678 bl.length()=199 2019-12-11T13:55:43.746 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.844+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9 from cache 2019-12-11T13:55:43.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.844+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=256 2019-12-11T13:55:43.762 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:43.860+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94423960169728 notifier 4678 bl.length()=256 2019-12-11T13:55:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.358+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.358+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-12-11T13:55:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-12-11T13:55:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-11T13:55:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.370+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:44.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.383+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=232 2019-12-11T13:55:44.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.383+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-12-11T13:55:44.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.383+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-11T13:55:44.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.383+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 state=0x55e0caa4ca30 s->prefetch_data=0 2019-12-11T13:55:44.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.383+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 : miss 2019-12-11T13:55:44.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 info.flags=0x16 2019-12-11T13:55:44.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 to cache LRU end 2019-12-11T13:55:44.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:44.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:44.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:44.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:44.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:44.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:44.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.397+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=324 2019-12-11T13:55:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 info.flags=0x13 2019-12-11T13:55:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 to cache LRU end 2019-12-11T13:55:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.418+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 2019-12-11T13:55:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.430+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8]) start [] num_entries 1100 2019-12-11T13:55:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.449+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-11T13:55:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.449+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-11T13:55:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.449+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-11T13:55:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.449+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.461+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.461+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.197 2019-12-11T13:55:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.461+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.461+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.461+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 2019-12-11T13:55:44.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:44.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:44.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.557+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.197 2019-12-11T13:55:44.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.627+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.637+0000 7fd6cb268ec0 10 manifest: total_size = 11534336 2019-12-11T13:55:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.637+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.204 2019-12-11T13:55:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.637+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.637+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.637+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-11T13:55:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-11T13:55:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-11T13:55:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-11T13:55:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.734+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.204 2019-12-11T13:55:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.806+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.817+0000 7fd6cb268ec0 10 manifest: total_size = 45360 2019-12-11T13:55:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.817+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.211 2019-12-11T13:55:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.817+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e0caa48898 s->prefetch_data=0 2019-12-11T13:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.817+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa48898 2019-12-11T13:55:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.817+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 2019-12-11T13:55:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2019-12-11T13:55:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2019-12-11T13:55:44.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2019-12-11T13:55:44.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2019-12-11T13:55:44.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.923+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.211 2019-12-11T13:55:44.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.996+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8]) start _multipart_[] num_entries 1001 2019-12-11T13:55:44.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:44.996+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.012+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:44.986 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.083+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:44.986 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.083+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:45.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-12-11T13:55:45.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-11T13:55:45.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:45.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:45.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:45.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-12-11T13:55:45.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.103+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-12-11T13:55:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.117+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781194 cookie 94423960172096 notifier 4678 bl.length()=194 2019-12-11T13:55:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.269+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8 from cache 2019-12-11T13:55:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.269+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=251 2019-12-11T13:55:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.279+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94423960169728 notifier 4678 bl.length()=251 2019-12-11T13:55:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.641+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.641+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-12-11T13:55:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-12-11T13:55:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-11T13:55:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.650+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:45.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.666+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=222 2019-12-11T13:55:45.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.666+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-12-11T13:55:45.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.666+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-11T13:55:45.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.666+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 state=0x55e0caa48280 s->prefetch_data=0 2019-12-11T13:55:45.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.666+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 : miss 2019-12-11T13:55:45.582 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 info.flags=0x16 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 to cache LRU end 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:45.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:45.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:45.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.680+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:45.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=314 2019-12-11T13:55:45.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 info.flags=0x13 2019-12-11T13:55:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 to cache LRU end 2019-12-11T13:55:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.694+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 2019-12-11T13:55:45.615 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.712+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6]) start [] num_entries 1100 2019-12-11T13:55:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.729+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-11T13:55:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.729+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-11T13:55:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.729+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-11T13:55:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.729+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.744+0000 7fd6cb268ec0 10 manifest: total_size = 10485760 2019-12-11T13:55:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.744+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.84 2019-12-11T13:55:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.744+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.744+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.744+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 2019-12-11T13:55:45.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.847+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.84 2019-12-11T13:55:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.913+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.921+0000 7fd6cb268ec0 10 manifest: total_size = 10485760 2019-12-11T13:55:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.921+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.85 2019-12-11T13:55:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.921+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.921+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.921+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 2019-12-11T13:55:45.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-11T13:55:45.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-11T13:55:45.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:45.995+0000 7fd6cb268ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.85 2019-12-11T13:55:45.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.060+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.069+0000 7fd6cb268ec0 10 manifest: total_size = 3305 2019-12-11T13:55:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.069+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.86 2019-12-11T13:55:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.069+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.069+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.069+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 2019-12-11T13:55:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.160+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6]) start _multipart_[] num_entries 1001 2019-12-11T13:55:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.160+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:46.119 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.216+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:46.211 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.308+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55e0caa48650 s->prefetch_data=0 2019-12-11T13:55:46.212 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.308+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-12-11T13:55:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-11T13:55:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-12-11T13:55:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.329+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-12-11T13:55:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.341+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781195 cookie 94423960152000 notifier 4678 bl.length()=184 2019-12-11T13:55:46.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.566+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6 from cache 2019-12-11T13:55:46.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.566+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=241 2019-12-11T13:55:46.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:46.575+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94423960148224 notifier 4678 bl.length()=241 2019-12-11T13:55:47.248 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.346+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55e0caa48280 s->prefetch_data=0 2019-12-11T13:55:47.248 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.346+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-12-11T13:55:47.264 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-12-11T13:55:47.264 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-11T13:55:47.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:47.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:47.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:47.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.362+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.371+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-11T13:55:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.371+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-12-11T13:55:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.371+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-11T13:55:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.371+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.371+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 : miss 2019-12-11T13:55:47.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 info.flags=0x16 2019-12-11T13:55:47.290 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 to cache LRU end 2019-12-11T13:55:47.290 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:47.290 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:47.291 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:47.291 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:47.291 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:47.291 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:47.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.387+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:47.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-11T13:55:47.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 info.flags=0x13 2019-12-11T13:55:47.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 to cache LRU end 2019-12-11T13:55:47.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:47.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:47.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.408+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 2019-12-11T13:55:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.432+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10]) start [] num_entries 1100 2019-12-11T13:55:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.466+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-11T13:55:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.466+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-11T13:55:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.466+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-11T13:55:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.466+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-11T13:55:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.466+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.485+0000 7fd6cb268ec0 10 manifest: total_size = 1035 2019-12-11T13:55:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.485+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.306 2019-12-11T13:55:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.485+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.485+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.485+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 2019-12-11T13:55:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.625+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.638+0000 7fd6cb268ec0 10 manifest: total_size = 49187 2019-12-11T13:55:47.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.638+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.308 2019-12-11T13:55:47.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.638+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.638+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:47.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.638+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 2019-12-11T13:55:47.728 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.826+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.846+0000 7fd6cb268ec0 10 manifest: total_size = 110 2019-12-11T13:55:47.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.846+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.307 2019-12-11T13:55:47.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.846+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.846+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:47.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:47.846+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 2019-12-11T13:55:47.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.035+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.089+0000 7fd6cb268ec0 10 manifest: total_size = 1048576 2019-12-11T13:55:47.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.089+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.305 2019-12-11T13:55:47.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.089+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:47.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.089+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:47.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.089+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 2019-12-11T13:55:48.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.273+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10]) start _multipart_[] num_entries 1001 2019-12-11T13:55:48.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.273+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:48.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.339+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.399+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55e0caa48cd0 s->prefetch_data=0 2019-12-11T13:55:48.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.399+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:48.314 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-12-11T13:55:48.314 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-11T13:55:48.314 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:48.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:48.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:48.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-12-11T13:55:48.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.412+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-11T13:55:48.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.424+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94423960148224 notifier 4678 bl.length()=181 2019-12-11T13:55:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.485+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.10 from cache 2019-12-11T13:55:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.485+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-12-11T13:55:48.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.500+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94423960175696 notifier 4678 bl.length()=239 2019-12-11T13:55:48.437 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:48.536+0000 7fd688fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:55:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.260+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55e0caa4d400 s->prefetch_data=0 2019-12-11T13:55:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.260+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-12-11T13:55:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-12-11T13:55:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-11T13:55:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.277+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.294+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-11T13:55:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.294+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-12-11T13:55:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.294+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-11T13:55:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.294+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.294+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 : miss 2019-12-11T13:55:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 info.flags=0x16 2019-12-11T13:55:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 to cache LRU end 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:49.214 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.310+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-11T13:55:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 info.flags=0x13 2019-12-11T13:55:49.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 to cache LRU end 2019-12-11T13:55:49.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:49.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:49.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.337+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 2019-12-11T13:55:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.362+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11]) start [] num_entries 1100 2019-12-11T13:55:49.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.401+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-11T13:55:49.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.401+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-11T13:55:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.401+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-11T13:55:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.401+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-11T13:55:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.401+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:49.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.419+0000 7fd6cb268ec0 10 manifest: total_size = 62 2019-12-11T13:55:49.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.419+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.313 2019-12-11T13:55:49.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.419+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:49.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.419+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:49.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.419+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 2019-12-11T13:55:49.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.558+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:49.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.567+0000 7fd6cb268ec0 10 manifest: total_size = 24595 2019-12-11T13:55:49.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.567+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.315 2019-12-11T13:55:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.567+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e0caa495d8 s->prefetch_data=0 2019-12-11T13:55:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.567+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa495d8 2019-12-11T13:55:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.567+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 2019-12-11T13:55:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.709+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e0caa4a118 s->prefetch_data=0 2019-12-11T13:55:49.620 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.719+0000 7fd6cb268ec0 10 manifest: total_size = 527 2019-12-11T13:55:49.620 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.719+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.314 2019-12-11T13:55:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.719+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e0caa4a118 s->prefetch_data=0 2019-12-11T13:55:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.719+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa4a118 2019-12-11T13:55:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.719+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 2019-12-11T13:55:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.824+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e0caa50398 s->prefetch_data=0 2019-12-11T13:55:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.839+0000 7fd6cb268ec0 10 manifest: total_size = 62 2019-12-11T13:55:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.839+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.312 2019-12-11T13:55:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.839+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e0caa50398 s->prefetch_data=0 2019-12-11T13:55:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.839+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa50398 2019-12-11T13:55:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.839+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 2019-12-11T13:55:49.836 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.934+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11]) start _multipart_[] num_entries 1001 2019-12-11T13:55:49.836 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:49.934+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:49.902 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.000+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.085+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55e0caa492a0 s->prefetch_data=0 2019-12-11T13:55:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.085+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-12-11T13:55:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.104+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-11T13:55:50.026 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.125+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94423960148224 notifier 4678 bl.length()=181 2019-12-11T13:55:50.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.560+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.11 from cache 2019-12-11T13:55:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.560+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-12-11T13:55:50.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:50.581+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94423960175696 notifier 4678 bl.length()=239 2019-12-11T13:55:50.956 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.055+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55e0caa48060 s->prefetch_data=0 2019-12-11T13:55:50.957 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.055+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-12-11T13:55:50.974 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-12-11T13:55:50.974 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-11T13:55:50.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:50.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:50.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-12-11T13:55:50.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.073+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.089+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-11T13:55:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.089+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-12-11T13:55:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.089+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-11T13:55:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.089+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 state=0x55e0caa48280 s->prefetch_data=0 2019-12-11T13:55:50.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.089+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 : miss 2019-12-11T13:55:51.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 info.flags=0x16 2019-12-11T13:55:51.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 to cache LRU end 2019-12-11T13:55:51.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 20 Read xattr: user.rgw.acl 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 20 Read xattr: user.rgw.idtag 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 : type miss (requested=0x13, cached=0x16) 2019-12-11T13:55:51.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.105+0000 7fd6cb268ec0 20 rados->read ofs=0 len=0 2019-12-11T13:55:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-11T13:55:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 info.flags=0x13 2019-12-11T13:55:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 to cache LRU end 2019-12-11T13:55:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-11T13:55:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.130+0000 7fd6cb268ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 2019-12-11T13:55:51.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.148+0000 7fd6cb268ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12]) start [] num_entries 1100 2019-12-11T13:55:51.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.163+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-11T13:55:51.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.163+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-11T13:55:51.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.163+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-11T13:55:51.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.163+0000 7fd6cb268ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-11T13:55:51.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.163+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.175+0000 7fd6cb268ec0 10 manifest: total_size = 0 2019-12-11T13:55:51.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.175+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.320 2019-12-11T13:55:51.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.175+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.175+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa49948 2019-12-11T13:55:51.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.175+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 2019-12-11T13:55:51.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.263+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.275+0000 7fd6cb268ec0 10 manifest: total_size = 0 2019-12-11T13:55:51.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.275+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.322 2019-12-11T13:55:51.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.275+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.275+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa49948 2019-12-11T13:55:51.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.275+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 2019-12-11T13:55:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.407+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.421+0000 7fd6cb268ec0 10 manifest: total_size = 0 2019-12-11T13:55:51.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.421+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.321 2019-12-11T13:55:51.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.421+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.421+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa49948 2019-12-11T13:55:51.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.421+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 2019-12-11T13:55:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.554+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.593+0000 7fd6cb268ec0 10 manifest: total_size = 0 2019-12-11T13:55:51.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.593+0000 7fd6cb268ec0 20 get_obj_state: setting s->obj_tag to bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.319 2019-12-11T13:55:51.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.593+0000 7fd6cb268ec0 20 get_obj_state: rctx=0x7ffddba84ac0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e0caa49948 s->prefetch_data=0 2019-12-11T13:55:51.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.593+0000 7fd6cb268ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e0caa49948 2019-12-11T13:55:51.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.593+0000 7fd6cb268ec0 20 bucket index object: default.rgw.buckets.index:.dir.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 2019-12-11T13:55:51.606 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.705+0000 7fd6cb268ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12]) start _multipart_[] num_entries 1001 2019-12-11T13:55:51.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.705+0000 7fd6cb268ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-11T13:55:51.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.771+0000 7fd6cb268ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12])"; objs.size()=0; is_truncated=0 2019-12-11T13:55:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.840+0000 7fd6cb268ec0 20 get_system_obj_state: rctx=0x7ffddba84458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55e0caa48840 s->prefetch_data=0 2019-12-11T13:55:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.840+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-12-11T13:55:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-12-11T13:55:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-11T13:55:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T13:55:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T13:55:51.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-12-11T13:55:51.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-12-11T13:55:51.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.851+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-11T13:55:51.768 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:51.867+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94423960148224 notifier 4678 bl.length()=181 2019-12-11T13:55:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.187+0000 7fd6cb268ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.12 from cache 2019-12-11T13:55:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.187+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-12-11T13:55:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.203+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94423960175696 notifier 4678 bl.length()=239 2019-12-11T13:55:52.357 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.456+0000 7fd6cb268ec0 10 removing key index: FPWHOIATUMXQOQHZATYV 2019-12-11T13:55:52.357 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.456+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-12-11T13:55:52.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.471+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94423960174656 notifier 4678 bl.length()=170 2019-12-11T13:55:52.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.601+0000 7fd6cb268ec0 10 removing email index: ragweed.client.0+test@test.test 2019-12-11T13:55:52.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.601+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-12-11T13:55:52.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.609+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781196 cookie 94423960152000 notifier 4678 bl.length()=182 2019-12-11T13:55:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.809+0000 7fd6cb268ec0 10 removing user buckets index 2019-12-11T13:55:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.809+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-12-11T13:55:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:52.821+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781197 cookie 94423960172096 notifier 4678 bl.length()=173 2019-12-11T13:55:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.346+0000 7fd6cb268ec0 10 removing user index: ragweed.client.0 2019-12-11T13:55:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.346+0000 7fd6cb268ec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-12-11T13:55:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.346+0000 7fd6cb268ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-12-11T13:55:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.364+0000 7fd6adffb700 10 RGWWatcher::handle_notify() notify_id 554050781190 cookie 94423960169728 notifier 4678 bl.length()=165 2019-12-11T13:55:53.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.793+0000 7fd6cb268ec0 20 remove_watcher() i=0 2019-12-11T13:55:53.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.793+0000 7fd6cb268ec0 2 removed watcher, disabling cache 2019-12-11T13:55:53.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.828+0000 7fd6cb268ec0 20 remove_watcher() i=1 2019-12-11T13:55:53.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.883+0000 7fd6cb268ec0 20 remove_watcher() i=2 2019-12-11T13:55:53.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.952+0000 7fd6cb268ec0 20 remove_watcher() i=3 2019-12-11T13:55:53.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:53.997+0000 7fd6cb268ec0 20 remove_watcher() i=4 2019-12-11T13:55:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:54.042+0000 7fd6cb268ec0 20 remove_watcher() i=5 2019-12-11T13:55:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:54.093+0000 7fd6cb268ec0 20 remove_watcher() i=6 2019-12-11T13:55:54.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:55:54.141+0000 7fd6cb268ec0 20 remove_watcher() i=7 2019-12-11T13:55:54.052 INFO:tasks.ragweed:Removing ragweed... 2019-12-11T13:55:54.052 INFO:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/ragweed 2019-12-11T13:55:54.170 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-12-11T13:55:54.196 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-12-11T13:55:54.196 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-12-11T13:55:54.197 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-12-11T13:55:54.197 INFO:teuthology.orchestra.run.smithi073:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-12-11T13:55:54.264 INFO:teuthology.orchestra.run.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-12-11T13:55:58.155 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-12-11T13:55:58.156 INFO:teuthology.orchestra.run.smithi073:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-12-11T13:56:00.649 INFO:teuthology.orchestra.run.smithi073.stdout: Gradle will be installed under /opt/gradle 2019-12-11T13:56:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:--2019-12-11 13:56:00-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-12-11T13:56:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.190.9, 104.18.191.9, 2606:4700::6812:bf09, ... 2019-12-11T13:56:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.190.9|:443... connected. 2019-12-11T13:56:00.768 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-12-11T13:56:00.768 INFO:teuthology.orchestra.run.smithi073.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-12-11T13:56:00.768 INFO:teuthology.orchestra.run.smithi073.stderr:--2019-12-11 13:56:00-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-12-11T13:56:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.159.20, 104.17.160.20, 2606:4700::6811:9f14, ... 2019-12-11T13:56:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.159.20|:443... connected. 2019-12-11T13:56:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 200 OK 2019-12-11T13:56:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:Length: 75323957 (72M) [application/zip] 2019-12-11T13:56:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-12-11T13:56:00.834 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T13:56:00.840 INFO:teuthology.orchestra.run.smithi073.stderr: 0K .......... .......... .......... .......... .......... 0% 6.59M 11s 2019-12-11T13:56:00.842 INFO:teuthology.orchestra.run.smithi073.stderr: 50K .......... .......... .......... .......... .......... 0% 164M 6s 2019-12-11T13:56:00.853 INFO:teuthology.orchestra.run.smithi073.stderr: 100K .......... .......... .......... .......... .......... 0% 6.82M 7s 2019-12-11T13:56:00.854 INFO:teuthology.orchestra.run.smithi073.stderr: 150K .......... .......... .......... .......... .......... 0% 157M 6s 2019-12-11T13:56:00.862 INFO:teuthology.orchestra.run.smithi073.stderr: 200K .......... .......... .......... .......... .......... 0% 113M 5s 2019-12-11T13:56:00.863 INFO:teuthology.orchestra.run.smithi073.stderr: 250K .......... .......... .......... .......... .......... 0% 112M 4s 2019-12-11T13:56:00.863 INFO:teuthology.orchestra.run.smithi073.stderr: 300K .......... .......... .......... .......... .......... 0% 179M 3s 2019-12-11T13:56:00.863 INFO:teuthology.orchestra.run.smithi073.stderr: 350K .......... .......... .......... .......... .......... 0% 7.70M 4s 2019-12-11T13:56:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 400K .......... .......... .......... .......... .......... 0% 157M 4s 2019-12-11T13:56:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 450K .......... .......... .......... .......... .......... 0% 181M 3s 2019-12-11T13:56:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 500K .......... .......... .......... .......... .......... 0% 112M 3s 2019-12-11T13:56:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 550K .......... .......... .......... .......... .......... 0% 115M 3s 2019-12-11T13:56:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 600K .......... .......... .......... .......... .......... 0% 111M 3s 2019-12-11T13:56:02.029 INFO:teuthology.orchestra.run.smithi073.stderr: 650K .......... .......... .......... .......... .......... 0% 128M 3s 2019-12-11T13:56:02.029 INFO:teuthology.orchestra.run.smithi073.stderr: 700K .......... .......... .......... .......... .......... 1% 125M 2s 2019-12-11T13:56:02.029 INFO:teuthology.orchestra.run.smithi073.stderr: 750K .......... .......... .......... .......... .......... 1% 118M 2s 2019-12-11T13:56:02.029 INFO:teuthology.orchestra.run.smithi073.stderr: 800K .......... .......... .......... .......... .......... 1% 11.1M 3s 2019-12-11T13:56:02.029 INFO:teuthology.orchestra.run.smithi073.stderr: 850K .......... .......... .......... .......... .......... 1% 159M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 900K .......... .......... .......... .......... .......... 1% 128M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 950K .......... .......... .......... .......... .......... 1% 89.0M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 1000K .......... .......... .......... .......... .......... 1% 149M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 1050K .......... .......... .......... .......... .......... 1% 115M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 1100K .......... .......... .......... .......... .......... 1% 163M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 1150K .......... .......... .......... .......... .......... 1% 99.1M 2s 2019-12-11T13:56:02.030 INFO:teuthology.orchestra.run.smithi073.stderr: 1200K .......... .......... .......... .......... .......... 1% 152M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1250K .......... .......... .......... .......... .......... 1% 129M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1300K .......... .......... .......... .......... .......... 1% 139M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1350K .......... .......... .......... .......... .......... 1% 114M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1400K .......... .......... .......... .......... .......... 1% 131M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1450K .......... .......... .......... .......... .......... 2% 153M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1500K .......... .......... .......... .......... .......... 2% 187M 2s 2019-12-11T13:56:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 1550K .......... .......... .......... .......... .......... 2% 126M 2s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1600K .......... .......... .......... .......... .......... 2% 133M 2s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1650K .......... .......... .......... .......... .......... 2% 150M 2s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1700K .......... .......... .......... .......... .......... 2% 118M 2s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1750K .......... .......... .......... .......... .......... 2% 152M 1s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1800K .......... .......... .......... .......... .......... 2% 132M 1s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1850K .......... .......... .......... .......... .......... 2% 121M 1s 2019-12-11T13:56:02.032 INFO:teuthology.orchestra.run.smithi073.stderr: 1900K .......... .......... .......... .......... .......... 2% 215M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 1950K .......... .......... .......... .......... .......... 2% 157M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2000K .......... .......... .......... .......... .......... 2% 171M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2050K .......... .......... .......... .......... .......... 2% 141M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2100K .......... .......... .......... .......... .......... 2% 185M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2150K .......... .......... .......... .......... .......... 2% 184M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2200K .......... .......... .......... .......... .......... 3% 203M 1s 2019-12-11T13:56:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2250K .......... .......... .......... .......... .......... 3% 226M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2300K .......... .......... .......... .......... .......... 3% 173M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2350K .......... .......... .......... .......... .......... 3% 140M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2400K .......... .......... .......... .......... .......... 3% 205M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2450K .......... .......... .......... .......... .......... 3% 202M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2500K .......... .......... .......... .......... .......... 3% 201M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2550K .......... .......... .......... .......... .......... 3% 126M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2600K .......... .......... .......... .......... .......... 3% 237M 1s 2019-12-11T13:56:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2650K .......... .......... .......... .......... .......... 3% 276M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2700K .......... .......... .......... .......... .......... 3% 190M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2750K .......... .......... .......... .......... .......... 3% 186M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2800K .......... .......... .......... .......... .......... 3% 204M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2850K .......... .......... .......... .......... .......... 3% 259M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2900K .......... .......... .......... .......... .......... 4% 271M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2950K .......... .......... .......... .......... .......... 4% 133M 1s 2019-12-11T13:56:02.035 INFO:teuthology.orchestra.run.smithi073.stderr: 3000K .......... .......... .......... .......... .......... 4% 110M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3050K .......... .......... .......... .......... .......... 4% 118M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3100K .......... .......... .......... .......... .......... 4% 306M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3150K .......... .......... .......... .......... .......... 4% 126M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3200K .......... .......... .......... .......... .......... 4% 147M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3250K .......... .......... .......... .......... .......... 4% 278M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3300K .......... .......... .......... .......... .......... 4% 286M 1s 2019-12-11T13:56:02.036 INFO:teuthology.orchestra.run.smithi073.stderr: 3350K .......... .......... .......... .......... .......... 4% 250M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3400K .......... .......... .......... .......... .......... 4% 223M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3450K .......... .......... .......... .......... .......... 4% 226M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3500K .......... .......... .......... .......... .......... 4% 221M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3550K .......... .......... .......... .......... .......... 4% 249M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3600K .......... .......... .......... .......... .......... 4% 300M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3650K .......... .......... .......... .......... .......... 5% 242M 1s 2019-12-11T13:56:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 3700K .......... .......... .......... .......... .......... 5% 227M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 3750K .......... .......... .......... .......... .......... 5% 256M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 3800K .......... .......... .......... .......... .......... 5% 241M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 3850K .......... .......... .......... .......... .......... 5% 251M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 3900K .......... .......... .......... .......... .......... 5% 260M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 3950K .......... .......... .......... .......... .......... 5% 219M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 4000K .......... .......... .......... .......... .......... 5% 262M 1s 2019-12-11T13:56:02.038 INFO:teuthology.orchestra.run.smithi073.stderr: 4050K .......... .......... .......... .......... .......... 5% 262M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4100K .......... .......... .......... .......... .......... 5% 265M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4150K .......... .......... .......... .......... .......... 5% 206M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4200K .......... .......... .......... .......... .......... 5% 245M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4250K .......... .......... .......... .......... .......... 5% 290M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4300K .......... .......... .......... .......... .......... 5% 279M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4350K .......... .......... .......... .......... .......... 5% 228M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4400K .......... .......... .......... .......... .......... 6% 296M 1s 2019-12-11T13:56:02.039 INFO:teuthology.orchestra.run.smithi073.stderr: 4450K .......... .......... .......... .......... .......... 6% 298M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4500K .......... .......... .......... .......... .......... 6% 271M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4550K .......... .......... .......... .......... .......... 6% 249M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4600K .......... .......... .......... .......... .......... 6% 283M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4650K .......... .......... .......... .......... .......... 6% 261M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4700K .......... .......... .......... .......... .......... 6% 260M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4750K .......... .......... .......... .......... .......... 6% 241M 1s 2019-12-11T13:56:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 4800K .......... .......... .......... .......... .......... 6% 282M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 4850K .......... .......... .......... .......... .......... 6% 277M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 4900K .......... .......... .......... .......... .......... 6% 320M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 4950K .......... .......... .......... .......... .......... 6% 287M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 5000K .......... .......... .......... .......... .......... 6% 280M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 5050K .......... .......... .......... .......... .......... 6% 292M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 5100K .......... .......... .......... .......... .......... 7% 264M 1s 2019-12-11T13:56:02.041 INFO:teuthology.orchestra.run.smithi073.stderr: 5150K .......... .......... .......... .......... .......... 7% 248M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5200K .......... .......... .......... .......... .......... 7% 267M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5250K .......... .......... .......... .......... .......... 7% 257M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5300K .......... .......... .......... .......... .......... 7% 269M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5350K .......... .......... .......... .......... .......... 7% 217M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5400K .......... .......... .......... .......... .......... 7% 293M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5450K .......... .......... .......... .......... .......... 7% 314M 1s 2019-12-11T13:56:02.042 INFO:teuthology.orchestra.run.smithi073.stderr: 5500K .......... .......... .......... .......... .......... 7% 305M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5550K .......... .......... .......... .......... .......... 7% 256M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5600K .......... .......... .......... .......... .......... 7% 287M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5650K .......... .......... .......... .......... .......... 7% 319M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5700K .......... .......... .......... .......... .......... 7% 213M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5750K .......... .......... .......... .......... .......... 7% 206M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5800K .......... .......... .......... .......... .......... 7% 246M 1s 2019-12-11T13:56:02.043 INFO:teuthology.orchestra.run.smithi073.stderr: 5850K .......... .......... .......... .......... .......... 8% 213M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 5900K .......... .......... .......... .......... .......... 8% 204M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 5950K .......... .......... .......... .......... .......... 8% 167M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 6000K .......... .......... .......... .......... .......... 8% 191M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 6050K .......... .......... .......... .......... .......... 8% 211M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 6100K .......... .......... .......... .......... .......... 8% 190M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 6150K .......... .......... .......... .......... .......... 8% 166M 1s 2019-12-11T13:56:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 6200K .......... .......... .......... .......... .......... 8% 179M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6250K .......... .......... .......... .......... .......... 8% 192M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6300K .......... .......... .......... .......... .......... 8% 198M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6350K .......... .......... .......... .......... .......... 8% 149M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6400K .......... .......... .......... .......... .......... 8% 186M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6450K .......... .......... .......... .......... .......... 8% 171M 1s 2019-12-11T13:56:02.045 INFO:teuthology.orchestra.run.smithi073.stderr: 6500K .......... .......... .......... .......... .......... 8% 192M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6550K .......... .......... .......... .......... .......... 8% 178M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6600K .......... .......... .......... .......... .......... 9% 211M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6650K .......... .......... .......... .......... .......... 9% 221M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6700K .......... .......... .......... .......... .......... 9% 228M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6750K .......... .......... .......... .......... .......... 9% 190M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6800K .......... .......... .......... .......... .......... 9% 204M 1s 2019-12-11T13:56:02.046 INFO:teuthology.orchestra.run.smithi073.stderr: 6850K .......... .......... .......... .......... .......... 9% 224M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 6900K .......... .......... .......... .......... .......... 9% 204M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 6950K .......... .......... .......... .......... .......... 9% 189M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 7000K .......... .......... .......... .......... .......... 9% 205M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 7050K .......... .......... .......... .......... .......... 9% 211M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 7100K .......... .......... .......... .......... .......... 9% 217M 1s 2019-12-11T13:56:02.047 INFO:teuthology.orchestra.run.smithi073.stderr: 7150K .......... .......... .......... .......... .......... 9% 185M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7200K .......... .......... .......... .......... .......... 9% 215M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7250K .......... .......... .......... .......... .......... 9% 235M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7300K .......... .......... .......... .......... .......... 9% 236M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7350K .......... .......... .......... .......... .......... 10% 203M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7400K .......... .......... .......... .......... .......... 10% 196M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7450K .......... .......... .......... .......... .......... 10% 211M 1s 2019-12-11T13:56:02.048 INFO:teuthology.orchestra.run.smithi073.stderr: 7500K .......... .......... .......... .......... .......... 10% 204M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7550K .......... .......... .......... .......... .......... 10% 139M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7600K .......... .......... .......... .......... .......... 10% 151M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7650K .......... .......... .......... .......... .......... 10% 205M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7700K .......... .......... .......... .......... .......... 10% 232M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7750K .......... .......... .......... .......... .......... 10% 209M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7800K .......... .......... .......... .......... .......... 10% 227M 1s 2019-12-11T13:56:02.049 INFO:teuthology.orchestra.run.smithi073.stderr: 7850K .......... .......... .......... .......... .......... 10% 229M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 7900K .......... .......... .......... .......... .......... 10% 218M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 7950K .......... .......... .......... .......... .......... 10% 184M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8000K .......... .......... .......... .......... .......... 10% 205M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8050K .......... .......... .......... .......... .......... 11% 215M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8100K .......... .......... .......... .......... .......... 11% 226M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8150K .......... .......... .......... .......... .......... 11% 190M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8200K .......... .......... .......... .......... .......... 11% 221M 1s 2019-12-11T13:56:02.050 INFO:teuthology.orchestra.run.smithi073.stderr: 8250K .......... .......... .......... .......... .......... 11% 213M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8300K .......... .......... .......... .......... .......... 11% 237M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8350K .......... .......... .......... .......... .......... 11% 180M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8400K .......... .......... .......... .......... .......... 11% 211M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8450K .......... .......... .......... .......... .......... 11% 218M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8500K .......... .......... .......... .......... .......... 11% 178M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8550K .......... .......... .......... .......... .......... 11% 178M 1s 2019-12-11T13:56:02.051 INFO:teuthology.orchestra.run.smithi073.stderr: 8600K .......... .......... .......... .......... .......... 11% 196M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8650K .......... .......... .......... .......... .......... 11% 194M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8700K .......... .......... .......... .......... .......... 11% 230M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8750K .......... .......... .......... .......... .......... 11% 187M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8800K .......... .......... .......... .......... .......... 12% 208M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8850K .......... .......... .......... .......... .......... 12% 220M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8900K .......... .......... .......... .......... .......... 12% 210M 1s 2019-12-11T13:56:02.052 INFO:teuthology.orchestra.run.smithi073.stderr: 8950K .......... .......... .......... .......... .......... 12% 192M 1s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9000K .......... .......... .......... .......... .......... 12% 210M 1s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9050K .......... .......... .......... .......... .......... 12% 231M 1s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9100K .......... .......... .......... .......... .......... 12% 218M 1s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9150K .......... .......... .......... .......... .......... 12% 188M 1s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9200K .......... .......... .......... .......... .......... 12% 234M 0s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9250K .......... .......... .......... .......... .......... 12% 233M 0s 2019-12-11T13:56:02.053 INFO:teuthology.orchestra.run.smithi073.stderr: 9300K .......... .......... .......... .......... .......... 12% 222M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9350K .......... .......... .......... .......... .......... 12% 217M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9400K .......... .......... .......... .......... .......... 12% 242M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9450K .......... .......... .......... .......... .......... 12% 236M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9500K .......... .......... .......... .......... .......... 12% 241M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9550K .......... .......... .......... .......... .......... 13% 196M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9600K .......... .......... .......... .......... .......... 13% 244M 0s 2019-12-11T13:56:02.054 INFO:teuthology.orchestra.run.smithi073.stderr: 9650K .......... .......... .......... .......... .......... 13% 232M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9700K .......... .......... .......... .......... .......... 13% 230M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9750K .......... .......... .......... .......... .......... 13% 199M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9800K .......... .......... .......... .......... .......... 13% 224M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9850K .......... .......... .......... .......... .......... 13% 226M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9900K .......... .......... .......... .......... .......... 13% 222M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 9950K .......... .......... .......... .......... .......... 13% 206M 0s 2019-12-11T13:56:02.055 INFO:teuthology.orchestra.run.smithi073.stderr: 10000K .......... .......... .......... .......... .......... 13% 197M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10050K .......... .......... .......... .......... .......... 13% 241M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10100K .......... .......... .......... .......... .......... 13% 249M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10150K .......... .......... .......... .......... .......... 13% 218M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10200K .......... .......... .......... .......... .......... 13% 237M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10250K .......... .......... .......... .......... .......... 14% 238M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10300K .......... .......... .......... .......... .......... 14% 239M 0s 2019-12-11T13:56:02.056 INFO:teuthology.orchestra.run.smithi073.stderr: 10350K .......... .......... .......... .......... .......... 14% 182M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10400K .......... .......... .......... .......... .......... 14% 215M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10450K .......... .......... .......... .......... .......... 14% 211M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10500K .......... .......... .......... .......... .......... 14% 232M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10550K .......... .......... .......... .......... .......... 14% 217M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10600K .......... .......... .......... .......... .......... 14% 219M 0s 2019-12-11T13:56:02.057 INFO:teuthology.orchestra.run.smithi073.stderr: 10650K .......... .......... .......... .......... .......... 14% 223M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10700K .......... .......... .......... .......... .......... 14% 225M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10750K .......... .......... .......... .......... .......... 14% 196M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10800K .......... .......... .......... .......... .......... 14% 217M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10850K .......... .......... .......... .......... .......... 14% 223M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10900K .......... .......... .......... .......... .......... 14% 223M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 10950K .......... .......... .......... .......... .......... 14% 202M 0s 2019-12-11T13:56:02.058 INFO:teuthology.orchestra.run.smithi073.stderr: 11000K .......... .......... .......... .......... .......... 15% 239M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11050K .......... .......... .......... .......... .......... 15% 223M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11100K .......... .......... .......... .......... .......... 15% 219M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11150K .......... .......... .......... .......... .......... 15% 158M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11200K .......... .......... .......... .......... .......... 15% 217M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11250K .......... .......... .......... .......... .......... 15% 230M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11300K .......... .......... .......... .......... .......... 15% 290M 0s 2019-12-11T13:56:02.059 INFO:teuthology.orchestra.run.smithi073.stderr: 11350K .......... .......... .......... .......... .......... 15% 233M 0s 2019-12-11T13:56:02.060 INFO:teuthology.orchestra.run.smithi073.stderr: 11400K .......... .......... .......... .......... .......... 15% 306M 0s 2019-12-11T13:56:02.060 INFO:teuthology.orchestra.run.smithi073.stderr: 11450K .......... .......... .......... .......... .......... 15% 295M 0s 2019-12-11T13:56:02.060 INFO:teuthology.orchestra.run.smithi073.stderr: 11500K .......... .......... .......... .......... .......... 15% 337M 0s 2019-12-11T13:56:02.060 INFO:teuthology.orchestra.run.smithi073.stderr: 11550K .......... .......... .......... .......... .......... 15% 261M 0s 2019-12-11T13:56:02.060 INFO:teuthology.orchestra.run.smithi073.stderr: 11600K .......... .......... .......... .......... .......... 15% 315M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11650K .......... .......... .......... .......... .......... 15% 294M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11700K .......... .......... .......... .......... .......... 15% 338M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11750K .......... .......... .......... .......... .......... 16% 296M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11800K .......... .......... .......... .......... .......... 16% 334M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11850K .......... .......... .......... .......... .......... 16% 319M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11900K .......... .......... .......... .......... .......... 16% 315M 0s 2019-12-11T13:56:02.061 INFO:teuthology.orchestra.run.smithi073.stderr: 11950K .......... .......... .......... .......... .......... 16% 274M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12000K .......... .......... .......... .......... .......... 16% 270M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12050K .......... .......... .......... .......... .......... 16% 234M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12100K .......... .......... .......... .......... .......... 16% 285M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12150K .......... .......... .......... .......... .......... 16% 284M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12200K .......... .......... .......... .......... .......... 16% 307M 0s 2019-12-11T13:56:02.062 INFO:teuthology.orchestra.run.smithi073.stderr: 12250K .......... .......... .......... .......... .......... 16% 272M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12300K .......... .......... .......... .......... .......... 16% 316M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12350K .......... .......... .......... .......... .......... 16% 283M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12400K .......... .......... .......... .......... .......... 16% 335M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12450K .......... .......... .......... .......... .......... 16% 345M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12500K .......... .......... .......... .......... .......... 17% 338M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12550K .......... .......... .......... .......... .......... 17% 284M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12600K .......... .......... .......... .......... .......... 17% 334M 0s 2019-12-11T13:56:02.063 INFO:teuthology.orchestra.run.smithi073.stderr: 12650K .......... .......... .......... .......... .......... 17% 333M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12700K .......... .......... .......... .......... .......... 17% 327M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12750K .......... .......... .......... .......... .......... 17% 284M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12800K .......... .......... .......... .......... .......... 17% 330M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12850K .......... .......... .......... .......... .......... 17% 306M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12900K .......... .......... .......... .......... .......... 17% 339M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 12950K .......... .......... .......... .......... .......... 17% 277M 0s 2019-12-11T13:56:02.064 INFO:teuthology.orchestra.run.smithi073.stderr: 13000K .......... .......... .......... .......... .......... 17% 299M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13050K .......... .......... .......... .......... .......... 17% 311M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13100K .......... .......... .......... .......... .......... 17% 339M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13150K .......... .......... .......... .......... .......... 17% 266M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13200K .......... .......... .......... .......... .......... 18% 270M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13250K .......... .......... .......... .......... .......... 18% 301M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13300K .......... .......... .......... .......... .......... 18% 296M 0s 2019-12-11T13:56:02.065 INFO:teuthology.orchestra.run.smithi073.stderr: 13350K .......... .......... .......... .......... .......... 18% 261M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13400K .......... .......... .......... .......... .......... 18% 307M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13450K .......... .......... .......... .......... .......... 18% 302M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13500K .......... .......... .......... .......... .......... 18% 344M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13550K .......... .......... .......... .......... .......... 18% 264M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13600K .......... .......... .......... .......... .......... 18% 308M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13650K .......... .......... .......... .......... .......... 18% 316M 0s 2019-12-11T13:56:02.066 INFO:teuthology.orchestra.run.smithi073.stderr: 13700K .......... .......... .......... .......... .......... 18% 334M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 13750K .......... .......... .......... .......... .......... 18% 268M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 13800K .......... .......... .......... .......... .......... 18% 216M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 13850K .......... .......... .......... .......... .......... 18% 199M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 13900K .......... .......... .......... .......... .......... 18% 229M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 13950K .......... .......... .......... .......... .......... 19% 208M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 14000K .......... .......... .......... .......... .......... 19% 236M 0s 2019-12-11T13:56:02.067 INFO:teuthology.orchestra.run.smithi073.stderr: 14050K .......... .......... .......... .......... .......... 19% 235M 0s 2019-12-11T13:56:02.068 INFO:teuthology.orchestra.run.smithi073.stderr: 14100K .......... .......... .......... .......... .......... 19% 222M 0s 2019-12-11T13:56:02.068 INFO:teuthology.orchestra.run.smithi073.stderr: 14150K .......... .......... .......... .......... .......... 19% 200M 0s 2019-12-11T13:56:02.068 INFO:teuthology.orchestra.run.smithi073.stderr: 14200K .......... .......... .......... .......... .......... 19% 243M 0s 2019-12-11T13:56:02.068 INFO:teuthology.orchestra.run.smithi073.stderr: 14250K .......... .......... .......... .......... .......... 19% 250M 0s 2019-12-11T13:56:02.068 INFO:teuthology.orchestra.run.smithi073.stderr: 14300K .......... .......... .......... .......... .......... 19% 254M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14350K .......... .......... .......... .......... .......... 19% 222M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14400K .......... .......... .......... .......... .......... 19% 244M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14450K .......... .......... .......... .......... .......... 19% 244M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14500K .......... .......... .......... .......... .......... 19% 239M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14550K .......... .......... .......... .......... .......... 19% 213M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14600K .......... .......... .......... .......... .......... 19% 257M 0s 2019-12-11T13:56:02.069 INFO:teuthology.orchestra.run.smithi073.stderr: 14650K .......... .......... .......... .......... .......... 19% 251M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14700K .......... .......... .......... .......... .......... 20% 231M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14750K .......... .......... .......... .......... .......... 20% 225M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14800K .......... .......... .......... .......... .......... 20% 259M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14850K .......... .......... .......... .......... .......... 20% 239M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14900K .......... .......... .......... .......... .......... 20% 243M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 14950K .......... .......... .......... .......... .......... 20% 208M 0s 2019-12-11T13:56:02.070 INFO:teuthology.orchestra.run.smithi073.stderr: 15000K .......... .......... .......... .......... .......... 20% 250M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15050K .......... .......... .......... .......... .......... 20% 244M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15100K .......... .......... .......... .......... .......... 20% 231M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15150K .......... .......... .......... .......... .......... 20% 217M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15200K .......... .......... .......... .......... .......... 20% 237M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15250K .......... .......... .......... .......... .......... 20% 255M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15300K .......... .......... .......... .......... .......... 20% 240M 0s 2019-12-11T13:56:02.071 INFO:teuthology.orchestra.run.smithi073.stderr: 15350K .......... .......... .......... .......... .......... 20% 208M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15400K .......... .......... .......... .......... .......... 21% 221M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15450K .......... .......... .......... .......... .......... 21% 236M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15500K .......... .......... .......... .......... .......... 21% 244M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15550K .......... .......... .......... .......... .......... 21% 222M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15600K .......... .......... .......... .......... .......... 21% 248M 0s 2019-12-11T13:56:02.072 INFO:teuthology.orchestra.run.smithi073.stderr: 15650K .......... .......... .......... .......... .......... 21% 254M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15700K .......... .......... .......... .......... .......... 21% 235M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15750K .......... .......... .......... .......... .......... 21% 199M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15800K .......... .......... .......... .......... .......... 21% 246M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15850K .......... .......... .......... .......... .......... 21% 239M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15900K .......... .......... .......... .......... .......... 21% 249M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 15950K .......... .......... .......... .......... .......... 21% 219M 0s 2019-12-11T13:56:02.073 INFO:teuthology.orchestra.run.smithi073.stderr: 16000K .......... .......... .......... .......... .......... 21% 228M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16050K .......... .......... .......... .......... .......... 21% 222M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16100K .......... .......... .......... .......... .......... 21% 233M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16150K .......... .......... .......... .......... .......... 22% 144M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16200K .......... .......... .......... .......... .......... 22% 205M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16250K .......... .......... .......... .......... .......... 22% 200M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16300K .......... .......... .......... .......... .......... 22% 207M 0s 2019-12-11T13:56:02.074 INFO:teuthology.orchestra.run.smithi073.stderr: 16350K .......... .......... .......... .......... .......... 22% 156M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16400K .......... .......... .......... .......... .......... 22% 214M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16450K .......... .......... .......... .......... .......... 22% 225M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16500K .......... .......... .......... .......... .......... 22% 228M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16550K .......... .......... .......... .......... .......... 22% 162M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16600K .......... .......... .......... .......... .......... 22% 207M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16650K .......... .......... .......... .......... .......... 22% 197M 0s 2019-12-11T13:56:02.075 INFO:teuthology.orchestra.run.smithi073.stderr: 16700K .......... .......... .......... .......... .......... 22% 235M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 16750K .......... .......... .......... .......... .......... 22% 205M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 16800K .......... .......... .......... .......... .......... 22% 229M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 16850K .......... .......... .......... .......... .......... 22% 206M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 16900K .......... .......... .......... .......... .......... 23% 175M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 16950K .......... .......... .......... .......... .......... 23% 164M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 17000K .......... .......... .......... .......... .......... 23% 243M 0s 2019-12-11T13:56:02.076 INFO:teuthology.orchestra.run.smithi073.stderr: 17050K .......... .......... .......... .......... .......... 23% 234M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17100K .......... .......... .......... .......... .......... 23% 254M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17150K .......... .......... .......... .......... .......... 23% 214M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17200K .......... .......... .......... .......... .......... 23% 233M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17250K .......... .......... .......... .......... .......... 23% 242M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17300K .......... .......... .......... .......... .......... 23% 260M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17350K .......... .......... .......... .......... .......... 23% 192M 0s 2019-12-11T13:56:02.077 INFO:teuthology.orchestra.run.smithi073.stderr: 17400K .......... .......... .......... .......... .......... 23% 234M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17450K .......... .......... .......... .......... .......... 23% 239M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17500K .......... .......... .......... .......... .......... 23% 263M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17550K .......... .......... .......... .......... .......... 23% 210M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17600K .......... .......... .......... .......... .......... 23% 263M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17650K .......... .......... .......... .......... .......... 24% 248M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17700K .......... .......... .......... .......... .......... 24% 220M 0s 2019-12-11T13:56:02.078 INFO:teuthology.orchestra.run.smithi073.stderr: 17750K .......... .......... .......... .......... .......... 24% 210M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 17800K .......... .......... .......... .......... .......... 24% 235M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 17850K .......... .......... .......... .......... .......... 24% 256M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 17900K .......... .......... .......... .......... .......... 24% 249M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 17950K .......... .......... .......... .......... .......... 24% 221M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 18000K .......... .......... .......... .......... .......... 24% 234M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 18050K .......... .......... .......... .......... .......... 24% 260M 0s 2019-12-11T13:56:02.079 INFO:teuthology.orchestra.run.smithi073.stderr: 18100K .......... .......... .......... .......... .......... 24% 226M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18150K .......... .......... .......... .......... .......... 24% 166M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18200K .......... .......... .......... .......... .......... 24% 241M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18250K .......... .......... .......... .......... .......... 24% 236M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18300K .......... .......... .......... .......... .......... 24% 244M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18350K .......... .......... .......... .......... .......... 25% 225M 0s 2019-12-11T13:56:02.080 INFO:teuthology.orchestra.run.smithi073.stderr: 18400K .......... .......... .......... .......... .......... 25% 264M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18450K .......... .......... .......... .......... .......... 25% 257M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18500K .......... .......... .......... .......... .......... 25% 259M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18550K .......... .......... .......... .......... .......... 25% 218M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18600K .......... .......... .......... .......... .......... 25% 242M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18650K .......... .......... .......... .......... .......... 25% 231M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18700K .......... .......... .......... .......... .......... 25% 236M 0s 2019-12-11T13:56:02.081 INFO:teuthology.orchestra.run.smithi073.stderr: 18750K .......... .......... .......... .......... .......... 25% 235M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 18800K .......... .......... .......... .......... .......... 25% 261M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 18850K .......... .......... .......... .......... .......... 25% 260M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 18900K .......... .......... .......... .......... .......... 25% 252M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 18950K .......... .......... .......... .......... .......... 25% 213M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 19000K .......... .......... .......... .......... .......... 25% 262M 0s 2019-12-11T13:56:02.082 INFO:teuthology.orchestra.run.smithi073.stderr: 19050K .......... .......... .......... .......... .......... 25% 271M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19100K .......... .......... .......... .......... .......... 26% 241M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19150K .......... .......... .......... .......... .......... 26% 236M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19200K .......... .......... .......... .......... .......... 26% 260M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19250K .......... .......... .......... .......... .......... 26% 256M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19300K .......... .......... .......... .......... .......... 26% 264M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19350K .......... .......... .......... .......... .......... 26% 204M 0s 2019-12-11T13:56:02.083 INFO:teuthology.orchestra.run.smithi073.stderr: 19400K .......... .......... .......... .......... .......... 26% 226M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19450K .......... .......... .......... .......... .......... 26% 231M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19500K .......... .......... .......... .......... .......... 26% 269M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19550K .......... .......... .......... .......... .......... 26% 230M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19600K .......... .......... .......... .......... .......... 26% 245M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19650K .......... .......... .......... .......... .......... 26% 245M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19700K .......... .......... .......... .......... .......... 26% 235M 0s 2019-12-11T13:56:02.084 INFO:teuthology.orchestra.run.smithi073.stderr: 19750K .......... .......... .......... .......... .......... 26% 188M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 19800K .......... .......... .......... .......... .......... 26% 228M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 19850K .......... .......... .......... .......... .......... 27% 255M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 19900K .......... .......... .......... .......... .......... 27% 268M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 19950K .......... .......... .......... .......... .......... 27% 236M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 20000K .......... .......... .......... .......... .......... 27% 235M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 20050K .......... .......... .......... .......... .......... 27% 247M 0s 2019-12-11T13:56:02.085 INFO:teuthology.orchestra.run.smithi073.stderr: 20100K .......... .......... .......... .......... .......... 27% 223M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20150K .......... .......... .......... .......... .......... 27% 200M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20200K .......... .......... .......... .......... .......... 27% 259M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20250K .......... .......... .......... .......... .......... 27% 236M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20300K .......... .......... .......... .......... .......... 27% 258M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20350K .......... .......... .......... .......... .......... 27% 217M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20400K .......... .......... .......... .......... .......... 27% 262M 0s 2019-12-11T13:56:02.086 INFO:teuthology.orchestra.run.smithi073.stderr: 20450K .......... .......... .......... .......... .......... 27% 265M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20500K .......... .......... .......... .......... .......... 27% 241M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20550K .......... .......... .......... .......... .......... 28% 236M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20600K .......... .......... .......... .......... .......... 28% 263M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20650K .......... .......... .......... .......... .......... 28% 268M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20700K .......... .......... .......... .......... .......... 28% 239M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20750K .......... .......... .......... .......... .......... 28% 216M 0s 2019-12-11T13:56:02.087 INFO:teuthology.orchestra.run.smithi073.stderr: 20800K .......... .......... .......... .......... .......... 28% 215M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 20850K .......... .......... .......... .......... .......... 28% 268M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 20900K .......... .......... .......... .......... .......... 28% 271M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 20950K .......... .......... .......... .......... .......... 28% 224M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 21000K .......... .......... .......... .......... .......... 28% 249M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 21050K .......... .......... .......... .......... .......... 28% 254M 0s 2019-12-11T13:56:02.088 INFO:teuthology.orchestra.run.smithi073.stderr: 21100K .......... .......... .......... .......... .......... 28% 257M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21150K .......... .......... .......... .......... .......... 28% 213M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21200K .......... .......... .......... .......... .......... 28% 251M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21250K .......... .......... .......... .......... .......... 28% 246M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21300K .......... .......... .......... .......... .......... 29% 244M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21350K .......... .......... .......... .......... .......... 29% 235M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21400K .......... .......... .......... .......... .......... 29% 267M 0s 2019-12-11T13:56:02.089 INFO:teuthology.orchestra.run.smithi073.stderr: 21450K .......... .......... .......... .......... .......... 29% 263M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21500K .......... .......... .......... .......... .......... 29% 279M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21550K .......... .......... .......... .......... .......... 29% 209M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21600K .......... .......... .......... .......... .......... 29% 233M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21650K .......... .......... .......... .......... .......... 29% 264M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21700K .......... .......... .......... .......... .......... 29% 249M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21750K .......... .......... .......... .......... .......... 29% 228M 0s 2019-12-11T13:56:02.090 INFO:teuthology.orchestra.run.smithi073.stderr: 21800K .......... .......... .......... .......... .......... 29% 282M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 21850K .......... .......... .......... .......... .......... 29% 271M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 21900K .......... .......... .......... .......... .......... 29% 248M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 21950K .......... .......... .......... .......... .......... 29% 220M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 22000K .......... .......... .......... .......... .......... 29% 263M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 22050K .......... .......... .......... .......... .......... 30% 262M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 22100K .......... .......... .......... .......... .......... 30% 254M 0s 2019-12-11T13:56:02.091 INFO:teuthology.orchestra.run.smithi073.stderr: 22150K .......... .......... .......... .......... .......... 30% 253M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22200K .......... .......... .......... .......... .......... 30% 254M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22250K .......... .......... .......... .......... .......... 30% 271M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22300K .......... .......... .......... .......... .......... 30% 252M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22350K .......... .......... .......... .......... .......... 30% 206M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22400K .......... .......... .......... .......... .......... 30% 259M 0s 2019-12-11T13:56:02.092 INFO:teuthology.orchestra.run.smithi073.stderr: 22450K .......... .......... .......... .......... .......... 30% 262M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22500K .......... .......... .......... .......... .......... 30% 225M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22550K .......... .......... .......... .......... .......... 30% 224M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22600K .......... .......... .......... .......... .......... 30% 216M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22650K .......... .......... .......... .......... .......... 30% 234M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22700K .......... .......... .......... .......... .......... 30% 242M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22750K .......... .......... .......... .......... .......... 30% 201M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22800K .......... .......... .......... .......... .......... 31% 255M 0s 2019-12-11T13:56:02.093 INFO:teuthology.orchestra.run.smithi073.stderr: 22850K .......... .......... .......... .......... .......... 31% 241M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 22900K .......... .......... .......... .......... .......... 31% 259M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 22950K .......... .......... .......... .......... .......... 31% 170M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 23000K .......... .......... .......... .......... .......... 31% 170M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 23050K .......... .......... .......... .......... .......... 31% 187M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 23100K .......... .......... .......... .......... .......... 31% 199M 0s 2019-12-11T13:56:02.094 INFO:teuthology.orchestra.run.smithi073.stderr: 23150K .......... .......... .......... .......... .......... 31% 180M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23200K .......... .......... .......... .......... .......... 31% 250M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23250K .......... .......... .......... .......... .......... 31% 256M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23300K .......... .......... .......... .......... .......... 31% 284M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23350K .......... .......... .......... .......... .......... 31% 211M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23400K .......... .......... .......... .......... .......... 31% 245M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23450K .......... .......... .......... .......... .......... 31% 232M 0s 2019-12-11T13:56:02.095 INFO:teuthology.orchestra.run.smithi073.stderr: 23500K .......... .......... .......... .......... .......... 32% 238M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23550K .......... .......... .......... .......... .......... 32% 211M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23600K .......... .......... .......... .......... .......... 32% 272M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23650K .......... .......... .......... .......... .......... 32% 286M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23700K .......... .......... .......... .......... .......... 32% 255M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23750K .......... .......... .......... .......... .......... 32% 250M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23800K .......... .......... .......... .......... .......... 32% 259M 0s 2019-12-11T13:56:02.096 INFO:teuthology.orchestra.run.smithi073.stderr: 23850K .......... .......... .......... .......... .......... 32% 281M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 23900K .......... .......... .......... .......... .......... 32% 283M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 23950K .......... .......... .......... .......... .......... 32% 226M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 24000K .......... .......... .......... .......... .......... 32% 258M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 24050K .......... .......... .......... .......... .......... 32% 265M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 24100K .......... .......... .......... .......... .......... 32% 271M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 24150K .......... .......... .......... .......... .......... 32% 234M 0s 2019-12-11T13:56:02.097 INFO:teuthology.orchestra.run.smithi073.stderr: 24200K .......... .......... .......... .......... .......... 32% 283M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24250K .......... .......... .......... .......... .......... 33% 249M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24300K .......... .......... .......... .......... .......... 33% 267M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24350K .......... .......... .......... .......... .......... 33% 222M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24400K .......... .......... .......... .......... .......... 33% 266M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24450K .......... .......... .......... .......... .......... 33% 277M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24500K .......... .......... .......... .......... .......... 33% 280M 0s 2019-12-11T13:56:02.098 INFO:teuthology.orchestra.run.smithi073.stderr: 24550K .......... .......... .......... .......... .......... 33% 245M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24600K .......... .......... .......... .......... .......... 33% 288M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24650K .......... .......... .......... .......... .......... 33% 281M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24700K .......... .......... .......... .......... .......... 33% 274M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24750K .......... .......... .......... .......... .......... 33% 231M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24800K .......... .......... .......... .......... .......... 33% 281M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24850K .......... .......... .......... .......... .......... 33% 275M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24900K .......... .......... .......... .......... .......... 33% 279M 0s 2019-12-11T13:56:02.099 INFO:teuthology.orchestra.run.smithi073.stderr: 24950K .......... .......... .......... .......... .......... 33% 262M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25000K .......... .......... .......... .......... .......... 34% 282M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25050K .......... .......... .......... .......... .......... 34% 301M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25100K .......... .......... .......... .......... .......... 34% 269M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25150K .......... .......... .......... .......... .......... 34% 210M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25200K .......... .......... .......... .......... .......... 34% 277M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25250K .......... .......... .......... .......... .......... 34% 254M 0s 2019-12-11T13:56:02.100 INFO:teuthology.orchestra.run.smithi073.stderr: 25300K .......... .......... .......... .......... .......... 34% 276M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25350K .......... .......... .......... .......... .......... 34% 209M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25400K .......... .......... .......... .......... .......... 34% 254M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25450K .......... .......... .......... .......... .......... 34% 273M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25500K .......... .......... .......... .......... .......... 34% 218M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25550K .......... .......... .......... .......... .......... 34% 179M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25600K .......... .......... .......... .......... .......... 34% 260M 0s 2019-12-11T13:56:02.101 INFO:teuthology.orchestra.run.smithi073.stderr: 25650K .......... .......... .......... .......... .......... 34% 251M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25700K .......... .......... .......... .......... .......... 35% 263M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25750K .......... .......... .......... .......... .......... 35% 242M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25800K .......... .......... .......... .......... .......... 35% 260M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25850K .......... .......... .......... .......... .......... 35% 271M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25900K .......... .......... .......... .......... .......... 35% 280M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 25950K .......... .......... .......... .......... .......... 35% 230M 0s 2019-12-11T13:56:02.102 INFO:teuthology.orchestra.run.smithi073.stderr: 26000K .......... .......... .......... .......... .......... 35% 288M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26050K .......... .......... .......... .......... .......... 35% 273M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26100K .......... .......... .......... .......... .......... 35% 243M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26150K .......... .......... .......... .......... .......... 35% 219M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26200K .......... .......... .......... .......... .......... 35% 239M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26250K .......... .......... .......... .......... .......... 35% 290M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26300K .......... .......... .......... .......... .......... 35% 268M 0s 2019-12-11T13:56:02.103 INFO:teuthology.orchestra.run.smithi073.stderr: 26350K .......... .......... .......... .......... .......... 35% 233M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26400K .......... .......... .......... .......... .......... 35% 259M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26450K .......... .......... .......... .......... .......... 36% 276M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26500K .......... .......... .......... .......... .......... 36% 236M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26550K .......... .......... .......... .......... .......... 36% 242M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26600K .......... .......... .......... .......... .......... 36% 252M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26650K .......... .......... .......... .......... .......... 36% 261M 0s 2019-12-11T13:56:02.104 INFO:teuthology.orchestra.run.smithi073.stderr: 26700K .......... .......... .......... .......... .......... 36% 274M 0s 2019-12-11T13:56:02.105 INFO:teuthology.orchestra.run.smithi073.stderr: 26750K .......... .......... .......... .......... .......... 36% 226M 0s 2019-12-11T13:56:02.105 INFO:teuthology.orchestra.run.smithi073.stderr: 26800K .......... .......... .......... .......... .......... 36% 255M 0s 2019-12-11T13:56:02.105 INFO:teuthology.orchestra.run.smithi073.stderr: 26850K .......... .......... .......... .......... .......... 36% 214M 0s 2019-12-11T13:56:02.105 INFO:teuthology.orchestra.run.smithi073.stderr: 26900K .......... .......... .......... .......... .......... 36% 234M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 26950K .......... .......... .......... .......... .......... 36% 206M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27000K .......... .......... .......... .......... .......... 36% 275M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27050K .......... .......... .......... .......... .......... 36% 255M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27100K .......... .......... .......... .......... .......... 36% 225M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27150K .......... .......... .......... .......... .......... 36% 188M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27200K .......... .......... .......... .......... .......... 37% 233M 0s 2019-12-11T13:56:02.106 INFO:teuthology.orchestra.run.smithi073.stderr: 27250K .......... .......... .......... .......... .......... 37% 269M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27300K .......... .......... .......... .......... .......... 37% 251M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27350K .......... .......... .......... .......... .......... 37% 204M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27400K .......... .......... .......... .......... .......... 37% 242M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27450K .......... .......... .......... .......... .......... 37% 244M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27500K .......... .......... .......... .......... .......... 37% 247M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27550K .......... .......... .......... .......... .......... 37% 179M 0s 2019-12-11T13:56:02.107 INFO:teuthology.orchestra.run.smithi073.stderr: 27600K .......... .......... .......... .......... .......... 37% 236M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27650K .......... .......... .......... .......... .......... 37% 223M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27700K .......... .......... .......... .......... .......... 37% 267M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27750K .......... .......... .......... .......... .......... 37% 249M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27800K .......... .......... .......... .......... .......... 37% 288M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27850K .......... .......... .......... .......... .......... 37% 261M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27900K .......... .......... .......... .......... .......... 37% 276M 0s 2019-12-11T13:56:02.108 INFO:teuthology.orchestra.run.smithi073.stderr: 27950K .......... .......... .......... .......... .......... 38% 235M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28000K .......... .......... .......... .......... .......... 38% 256M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28050K .......... .......... .......... .......... .......... 38% 266M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28100K .......... .......... .......... .......... .......... 38% 270M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28150K .......... .......... .......... .......... .......... 38% 250M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28200K .......... .......... .......... .......... .......... 38% 293M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28250K .......... .......... .......... .......... .......... 38% 264M 0s 2019-12-11T13:56:02.109 INFO:teuthology.orchestra.run.smithi073.stderr: 28300K .......... .......... .......... .......... .......... 38% 284M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28350K .......... .......... .......... .......... .......... 38% 218M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28400K .......... .......... .......... .......... .......... 38% 295M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28450K .......... .......... .......... .......... .......... 38% 227M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28500K .......... .......... .......... .......... .......... 38% 271M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28550K .......... .......... .......... .......... .......... 38% 220M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28600K .......... .......... .......... .......... .......... 38% 242M 0s 2019-12-11T13:56:02.110 INFO:teuthology.orchestra.run.smithi073.stderr: 28650K .......... .......... .......... .......... .......... 39% 265M 0s 2019-12-11T13:56:02.111 INFO:teuthology.orchestra.run.smithi073.stderr: 28700K .......... .......... .......... .......... .......... 39% 272M 0s 2019-12-11T13:56:02.111 INFO:teuthology.orchestra.run.smithi073.stderr: 28750K .......... .......... .......... .......... .......... 39% 231M 0s 2019-12-11T13:56:02.111 INFO:teuthology.orchestra.run.smithi073.stderr: 28800K .......... .......... .......... .......... .......... 39% 221M 0s 2019-12-11T13:56:02.111 INFO:teuthology.orchestra.run.smithi073.stderr: 28850K .......... .......... .......... .......... .......... 39% 249M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 28900K .......... .......... .......... .......... .......... 39% 274M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 28950K .......... .......... .......... .......... .......... 39% 253M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 29000K .......... .......... .......... .......... .......... 39% 292M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 29050K .......... .......... .......... .......... .......... 39% 279M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 29100K .......... .......... .......... .......... .......... 39% 254M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 29150K .......... .......... .......... .......... .......... 39% 226M 0s 2019-12-11T13:56:02.112 INFO:teuthology.orchestra.run.smithi073.stderr: 29200K .......... .......... .......... .......... .......... 39% 258M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29250K .......... .......... .......... .......... .......... 39% 290M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29300K .......... .......... .......... .......... .......... 39% 268M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29350K .......... .......... .......... .......... .......... 39% 248M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29400K .......... .......... .......... .......... .......... 40% 281M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29450K .......... .......... .......... .......... .......... 40% 298M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29500K .......... .......... .......... .......... .......... 40% 280M 0s 2019-12-11T13:56:02.113 INFO:teuthology.orchestra.run.smithi073.stderr: 29550K .......... .......... .......... .......... .......... 40% 200M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29600K .......... .......... .......... .......... .......... 40% 252M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29650K .......... .......... .......... .......... .......... 40% 263M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29700K .......... .......... .......... .......... .......... 40% 284M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29750K .......... .......... .......... .......... .......... 40% 257M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29800K .......... .......... .......... .......... .......... 40% 275M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29850K .......... .......... .......... .......... .......... 40% 283M 0s 2019-12-11T13:56:02.114 INFO:teuthology.orchestra.run.smithi073.stderr: 29900K .......... .......... .......... .......... .......... 40% 272M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 29950K .......... .......... .......... .......... .......... 40% 216M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30000K .......... .......... .......... .......... .......... 40% 218M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30050K .......... .......... .......... .......... .......... 40% 231M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30100K .......... .......... .......... .......... .......... 40% 249M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30150K .......... .......... .......... .......... .......... 41% 180M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30200K .......... .......... .......... .......... .......... 41% 224M 0s 2019-12-11T13:56:02.115 INFO:teuthology.orchestra.run.smithi073.stderr: 30250K .......... .......... .......... .......... .......... 41% 261M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30300K .......... .......... .......... .......... .......... 41% 257M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30350K .......... .......... .......... .......... .......... 41% 215M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30400K .......... .......... .......... .......... .......... 41% 246M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30450K .......... .......... .......... .......... .......... 41% 250M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30500K .......... .......... .......... .......... .......... 41% 254M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30550K .......... .......... .......... .......... .......... 41% 217M 0s 2019-12-11T13:56:02.116 INFO:teuthology.orchestra.run.smithi073.stderr: 30600K .......... .......... .......... .......... .......... 41% 258M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30650K .......... .......... .......... .......... .......... 41% 258M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30700K .......... .......... .......... .......... .......... 41% 246M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30750K .......... .......... .......... .......... .......... 41% 232M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30800K .......... .......... .......... .......... .......... 41% 257M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30850K .......... .......... .......... .......... .......... 42% 281M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30900K .......... .......... .......... .......... .......... 42% 238M 0s 2019-12-11T13:56:02.117 INFO:teuthology.orchestra.run.smithi073.stderr: 30950K .......... .......... .......... .......... .......... 42% 217M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31000K .......... .......... .......... .......... .......... 42% 232M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31050K .......... .......... .......... .......... .......... 42% 257M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31100K .......... .......... .......... .......... .......... 42% 237M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31150K .......... .......... .......... .......... .......... 42% 201M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31200K .......... .......... .......... .......... .......... 42% 247M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31250K .......... .......... .......... .......... .......... 42% 245M 0s 2019-12-11T13:56:02.118 INFO:teuthology.orchestra.run.smithi073.stderr: 31300K .......... .......... .......... .......... .......... 42% 251M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31350K .......... .......... .......... .......... .......... 42% 239M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31400K .......... .......... .......... .......... .......... 42% 247M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31450K .......... .......... .......... .......... .......... 42% 260M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31500K .......... .......... .......... .......... .......... 42% 231M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31550K .......... .......... .......... .......... .......... 42% 191M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31600K .......... .......... .......... .......... .......... 43% 268M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31650K .......... .......... .......... .......... .......... 43% 207M 0s 2019-12-11T13:56:02.119 INFO:teuthology.orchestra.run.smithi073.stderr: 31700K .......... .......... .......... .......... .......... 43% 271M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 31750K .......... .......... .......... .......... .......... 43% 222M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 31800K .......... .......... .......... .......... .......... 43% 258M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 31850K .......... .......... .......... .......... .......... 43% 253M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 31900K .......... .......... .......... .......... .......... 43% 258M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 31950K .......... .......... .......... .......... .......... 43% 216M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 32000K .......... .......... .......... .......... .......... 43% 281M 0s 2019-12-11T13:56:02.120 INFO:teuthology.orchestra.run.smithi073.stderr: 32050K .......... .......... .......... .......... .......... 43% 263M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32100K .......... .......... .......... .......... .......... 43% 262M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32150K .......... .......... .......... .......... .......... 43% 236M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32200K .......... .......... .......... .......... .......... 43% 260M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32250K .......... .......... .......... .......... .......... 43% 244M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32300K .......... .......... .......... .......... .......... 43% 252M 0s 2019-12-11T13:56:02.121 INFO:teuthology.orchestra.run.smithi073.stderr: 32350K .......... .......... .......... .......... .......... 44% 184M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32400K .......... .......... .......... .......... .......... 44% 232M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32450K .......... .......... .......... .......... .......... 44% 194M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32500K .......... .......... .......... .......... .......... 44% 195M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32550K .......... .......... .......... .......... .......... 44% 196M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32600K .......... .......... .......... .......... .......... 44% 186M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32650K .......... .......... .......... .......... .......... 44% 259M 0s 2019-12-11T13:56:02.122 INFO:teuthology.orchestra.run.smithi073.stderr: 32700K .......... .......... .......... .......... .......... 44% 233M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 32750K .......... .......... .......... .......... .......... 44% 207M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 32800K .......... .......... .......... .......... .......... 44% 236M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 32850K .......... .......... .......... .......... .......... 44% 231M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 32900K .......... .......... .......... .......... .......... 44% 239M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 32950K .......... .......... .......... .......... .......... 44% 223M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 33000K .......... .......... .......... .......... .......... 44% 249M 0s 2019-12-11T13:56:02.123 INFO:teuthology.orchestra.run.smithi073.stderr: 33050K .......... .......... .......... .......... .......... 44% 248M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33100K .......... .......... .......... .......... .......... 45% 269M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33150K .......... .......... .......... .......... .......... 45% 219M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33200K .......... .......... .......... .......... .......... 45% 264M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33250K .......... .......... .......... .......... .......... 45% 242M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33300K .......... .......... .......... .......... .......... 45% 241M 0s 2019-12-11T13:56:02.124 INFO:teuthology.orchestra.run.smithi073.stderr: 33350K .......... .......... .......... .......... .......... 45% 234M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33400K .......... .......... .......... .......... .......... 45% 254M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33450K .......... .......... .......... .......... .......... 45% 280M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33500K .......... .......... .......... .......... .......... 45% 253M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33550K .......... .......... .......... .......... .......... 45% 199M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33600K .......... .......... .......... .......... .......... 45% 240M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33650K .......... .......... .......... .......... .......... 45% 273M 0s 2019-12-11T13:56:02.125 INFO:teuthology.orchestra.run.smithi073.stderr: 33700K .......... .......... .......... .......... .......... 45% 241M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 33750K .......... .......... .......... .......... .......... 45% 265M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 33800K .......... .......... .......... .......... .......... 46% 253M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 33850K .......... .......... .......... .......... .......... 46% 269M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 33900K .......... .......... .......... .......... .......... 46% 244M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 33950K .......... .......... .......... .......... .......... 46% 205M 0s 2019-12-11T13:56:02.126 INFO:teuthology.orchestra.run.smithi073.stderr: 34000K .......... .......... .......... .......... .......... 46% 275M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34050K .......... .......... .......... .......... .......... 46% 240M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34100K .......... .......... .......... .......... .......... 46% 283M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34150K .......... .......... .......... .......... .......... 46% 249M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34200K .......... .......... .......... .......... .......... 46% 296M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34250K .......... .......... .......... .......... .......... 46% 292M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34300K .......... .......... .......... .......... .......... 46% 296M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34350K .......... .......... .......... .......... .......... 46% 214M 0s 2019-12-11T13:56:02.127 INFO:teuthology.orchestra.run.smithi073.stderr: 34400K .......... .......... .......... .......... .......... 46% 273M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34450K .......... .......... .......... .......... .......... 46% 284M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34500K .......... .......... .......... .......... .......... 46% 253M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34550K .......... .......... .......... .......... .......... 47% 266M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34600K .......... .......... .......... .......... .......... 47% 274M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34650K .......... .......... .......... .......... .......... 47% 270M 0s 2019-12-11T13:56:02.128 INFO:teuthology.orchestra.run.smithi073.stderr: 34700K .......... .......... .......... .......... .......... 47% 285M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 34750K .......... .......... .......... .......... .......... 47% 233M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 34800K .......... .......... .......... .......... .......... 47% 268M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 34850K .......... .......... .......... .......... .......... 47% 259M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 34900K .......... .......... .......... .......... .......... 47% 284M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 34950K .......... .......... .......... .......... .......... 47% 233M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 35000K .......... .......... .......... .......... .......... 47% 286M 0s 2019-12-11T13:56:02.129 INFO:teuthology.orchestra.run.smithi073.stderr: 35050K .......... .......... .......... .......... .......... 47% 288M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35100K .......... .......... .......... .......... .......... 47% 278M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35150K .......... .......... .......... .......... .......... 47% 224M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35200K .......... .......... .......... .......... .......... 47% 272M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35250K .......... .......... .......... .......... .......... 47% 279M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35300K .......... .......... .......... .......... .......... 48% 275M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35350K .......... .......... .......... .......... .......... 48% 254M 0s 2019-12-11T13:56:02.130 INFO:teuthology.orchestra.run.smithi073.stderr: 35400K .......... .......... .......... .......... .......... 48% 241M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35450K .......... .......... .......... .......... .......... 48% 282M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35500K .......... .......... .......... .......... .......... 48% 281M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35550K .......... .......... .......... .......... .......... 48% 246M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35600K .......... .......... .......... .......... .......... 48% 263M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35650K .......... .......... .......... .......... .......... 48% 269M 0s 2019-12-11T13:56:02.131 INFO:teuthology.orchestra.run.smithi073.stderr: 35700K .......... .......... .......... .......... .......... 48% 281M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 35750K .......... .......... .......... .......... .......... 48% 261M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 35800K .......... .......... .......... .......... .......... 48% 280M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 35850K .......... .......... .......... .......... .......... 48% 294M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 35900K .......... .......... .......... .......... .......... 48% 293M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 35950K .......... .......... .......... .......... .......... 48% 224M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 36000K .......... .......... .......... .......... .......... 49% 299M 0s 2019-12-11T13:56:02.132 INFO:teuthology.orchestra.run.smithi073.stderr: 36050K .......... .......... .......... .......... .......... 49% 271M 0s 2019-12-11T13:56:02.133 INFO:teuthology.orchestra.run.smithi073.stderr: 36100K .......... .......... .......... .......... .......... 49% 275M 0s 2019-12-11T13:56:02.133 INFO:teuthology.orchestra.run.smithi073.stderr: 36150K .......... .......... .......... .......... .......... 49% 254M 0s 2019-12-11T13:56:02.133 INFO:teuthology.orchestra.run.smithi073.stderr: 36200K .......... .......... .......... .......... .......... 49% 284M 0s 2019-12-11T13:56:02.133 INFO:teuthology.orchestra.run.smithi073.stderr: 36250K .......... .......... .......... .......... .......... 49% 264M 0s 2019-12-11T13:56:02.133 INFO:teuthology.orchestra.run.smithi073.stderr: 36300K .......... .......... .......... .......... .......... 49% 292M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36350K .......... .......... .......... .......... .......... 49% 219M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36400K .......... .......... .......... .......... .......... 49% 289M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36450K .......... .......... .......... .......... .......... 49% 295M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36500K .......... .......... .......... .......... .......... 49% 282M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36550K .......... .......... .......... .......... .......... 49% 258M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36600K .......... .......... .......... .......... .......... 49% 280M 0s 2019-12-11T13:56:02.134 INFO:teuthology.orchestra.run.smithi073.stderr: 36650K .......... .......... .......... .......... .......... 49% 269M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36700K .......... .......... .......... .......... .......... 49% 277M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36750K .......... .......... .......... .......... .......... 50% 239M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36800K .......... .......... .......... .......... .......... 50% 277M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36850K .......... .......... .......... .......... .......... 50% 257M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36900K .......... .......... .......... .......... .......... 50% 290M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 36950K .......... .......... .......... .......... .......... 50% 258M 0s 2019-12-11T13:56:02.135 INFO:teuthology.orchestra.run.smithi073.stderr: 37000K .......... .......... .......... .......... .......... 50% 271M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37050K .......... .......... .......... .......... .......... 50% 279M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37100K .......... .......... .......... .......... .......... 50% 270M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37150K .......... .......... .......... .......... .......... 50% 238M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37200K .......... .......... .......... .......... .......... 50% 267M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37250K .......... .......... .......... .......... .......... 50% 265M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37300K .......... .......... .......... .......... .......... 50% 299M 0s 2019-12-11T13:56:02.136 INFO:teuthology.orchestra.run.smithi073.stderr: 37350K .......... .......... .......... .......... .......... 50% 233M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37400K .......... .......... .......... .......... .......... 50% 289M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37450K .......... .......... .......... .......... .......... 50% 295M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37500K .......... .......... .......... .......... .......... 51% 286M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37550K .......... .......... .......... .......... .......... 51% 239M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37600K .......... .......... .......... .......... .......... 51% 273M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37650K .......... .......... .......... .......... .......... 51% 287M 0s 2019-12-11T13:56:02.137 INFO:teuthology.orchestra.run.smithi073.stderr: 37700K .......... .......... .......... .......... .......... 51% 280M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 37750K .......... .......... .......... .......... .......... 51% 267M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 37800K .......... .......... .......... .......... .......... 51% 294M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 37850K .......... .......... .......... .......... .......... 51% 287M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 37900K .......... .......... .......... .......... .......... 51% 286M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 37950K .......... .......... .......... .......... .......... 51% 246M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 38000K .......... .......... .......... .......... .......... 51% 291M 0s 2019-12-11T13:56:02.138 INFO:teuthology.orchestra.run.smithi073.stderr: 38050K .......... .......... .......... .......... .......... 51% 285M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38100K .......... .......... .......... .......... .......... 51% 293M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38150K .......... .......... .......... .......... .......... 51% 260M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38200K .......... .......... .......... .......... .......... 51% 287M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38250K .......... .......... .......... .......... .......... 52% 296M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38300K .......... .......... .......... .......... .......... 52% 231M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38350K .......... .......... .......... .......... .......... 52% 191M 0s 2019-12-11T13:56:02.139 INFO:teuthology.orchestra.run.smithi073.stderr: 38400K .......... .......... .......... .......... .......... 52% 278M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38450K .......... .......... .......... .......... .......... 52% 275M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38500K .......... .......... .......... .......... .......... 52% 294M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38550K .......... .......... .......... .......... .......... 52% 245M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38600K .......... .......... .......... .......... .......... 52% 271M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38650K .......... .......... .......... .......... .......... 52% 266M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38700K .......... .......... .......... .......... .......... 52% 275M 0s 2019-12-11T13:56:02.140 INFO:teuthology.orchestra.run.smithi073.stderr: 38750K .......... .......... .......... .......... .......... 52% 206M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 38800K .......... .......... .......... .......... .......... 52% 294M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 38850K .......... .......... .......... .......... .......... 52% 277M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 38900K .......... .......... .......... .......... .......... 52% 276M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 38950K .......... .......... .......... .......... .......... 53% 262M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 39000K .......... .......... .......... .......... .......... 53% 273M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 39050K .......... .......... .......... .......... .......... 53% 279M 0s 2019-12-11T13:56:02.141 INFO:teuthology.orchestra.run.smithi073.stderr: 39100K .......... .......... .......... .......... .......... 53% 285M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39150K .......... .......... .......... .......... .......... 53% 244M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39200K .......... .......... .......... .......... .......... 53% 291M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39250K .......... .......... .......... .......... .......... 53% 283M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39300K .......... .......... .......... .......... .......... 53% 293M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39350K .......... .......... .......... .......... .......... 53% 265M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39400K .......... .......... .......... .......... .......... 53% 301M 0s 2019-12-11T13:56:02.142 INFO:teuthology.orchestra.run.smithi073.stderr: 39450K .......... .......... .......... .......... .......... 53% 290M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39500K .......... .......... .......... .......... .......... 53% 292M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39550K .......... .......... .......... .......... .......... 53% 231M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39600K .......... .......... .......... .......... .......... 53% 272M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39650K .......... .......... .......... .......... .......... 53% 282M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39700K .......... .......... .......... .......... .......... 54% 275M 0s 2019-12-11T13:56:02.143 INFO:teuthology.orchestra.run.smithi073.stderr: 39750K .......... .......... .......... .......... .......... 54% 330M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 39800K .......... .......... .......... .......... .......... 54% 352M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 39850K .......... .......... .......... .......... .......... 54% 371M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 39900K .......... .......... .......... .......... .......... 54% 366M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 39950K .......... .......... .......... .......... .......... 54% 301M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 40000K .......... .......... .......... .......... .......... 54% 337M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 40050K .......... .......... .......... .......... .......... 54% 388M 0s 2019-12-11T13:56:02.144 INFO:teuthology.orchestra.run.smithi073.stderr: 40100K .......... .......... .......... .......... .......... 54% 377M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40150K .......... .......... .......... .......... .......... 54% 312M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40200K .......... .......... .......... .......... .......... 54% 398M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40250K .......... .......... .......... .......... .......... 54% 379M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40300K .......... .......... .......... .......... .......... 54% 377M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40350K .......... .......... .......... .......... .......... 54% 332M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40400K .......... .......... .......... .......... .......... 54% 394M 0s 2019-12-11T13:56:02.145 INFO:teuthology.orchestra.run.smithi073.stderr: 40450K .......... .......... .......... .......... .......... 55% 401M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40500K .......... .......... .......... .......... .......... 55% 377M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40550K .......... .......... .......... .......... .......... 55% 339M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40600K .......... .......... .......... .......... .......... 55% 406M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40650K .......... .......... .......... .......... .......... 55% 381M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40700K .......... .......... .......... .......... .......... 55% 406M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40750K .......... .......... .......... .......... .......... 55% 335M 0s 2019-12-11T13:56:02.146 INFO:teuthology.orchestra.run.smithi073.stderr: 40800K .......... .......... .......... .......... .......... 55% 409M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 40850K .......... .......... .......... .......... .......... 55% 413M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 40900K .......... .......... .......... .......... .......... 55% 388M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 40950K .......... .......... .......... .......... .......... 55% 351M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 41000K .......... .......... .......... .......... .......... 55% 346M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 41050K .......... .......... .......... .......... .......... 55% 327M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 41100K .......... .......... .......... .......... .......... 55% 363M 0s 2019-12-11T13:56:02.147 INFO:teuthology.orchestra.run.smithi073.stderr: 41150K .......... .......... .......... .......... .......... 56% 288M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41200K .......... .......... .......... .......... .......... 56% 421M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41250K .......... .......... .......... .......... .......... 56% 319M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41300K .......... .......... .......... .......... .......... 56% 435M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41350K .......... .......... .......... .......... .......... 56% 306M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41400K .......... .......... .......... .......... .......... 56% 398M 0s 2019-12-11T13:56:02.148 INFO:teuthology.orchestra.run.smithi073.stderr: 41450K .......... .......... .......... .......... .......... 56% 425M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41500K .......... .......... .......... .......... .......... 56% 390M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41550K .......... .......... .......... .......... .......... 56% 362M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41600K .......... .......... .......... .......... .......... 56% 416M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41650K .......... .......... .......... .......... .......... 56% 398M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41700K .......... .......... .......... .......... .......... 56% 383M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41750K .......... .......... .......... .......... .......... 56% 331M 0s 2019-12-11T13:56:02.149 INFO:teuthology.orchestra.run.smithi073.stderr: 41800K .......... .......... .......... .......... .......... 56% 421M 0s 2019-12-11T13:56:02.150 INFO:teuthology.orchestra.run.smithi073.stderr: 41850K .......... .......... .......... .......... .......... 56% 415M 0s 2019-12-11T13:56:02.150 INFO:teuthology.orchestra.run.smithi073.stderr: 41900K .......... .......... .......... .......... .......... 57% 405M 0s 2019-12-11T13:56:02.150 INFO:teuthology.orchestra.run.smithi073.stderr: 41950K .......... .......... .......... .......... .......... 57% 370M 0s 2019-12-11T13:56:02.150 INFO:teuthology.orchestra.run.smithi073.stderr: 42000K .......... .......... .......... .......... .......... 57% 333M 0s 2019-12-11T13:56:02.151 INFO:teuthology.orchestra.run.smithi073.stderr: 42050K .......... .......... .......... .......... .......... 57% 383M 0s 2019-12-11T13:56:02.151 INFO:teuthology.orchestra.run.smithi073.stderr: 42100K .......... .......... .......... .......... .......... 57% 380M 0s 2019-12-11T13:56:02.151 INFO:teuthology.orchestra.run.smithi073.stderr: 42150K .......... .......... .......... .......... .......... 57% 308M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42200K .......... .......... .......... .......... .......... 57% 386M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42250K .......... .......... .......... .......... .......... 57% 372M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42300K .......... .......... .......... .......... .......... 57% 396M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42350K .......... .......... .......... .......... .......... 57% 357M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42400K .......... .......... .......... .......... .......... 57% 366M 0s 2019-12-11T13:56:02.152 INFO:teuthology.orchestra.run.smithi073.stderr: 42450K .......... .......... .......... .......... .......... 57% 387M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42500K .......... .......... .......... .......... .......... 57% 360M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42550K .......... .......... .......... .......... .......... 57% 326M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42600K .......... .......... .......... .......... .......... 57% 413M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42650K .......... .......... .......... .......... .......... 58% 407M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42700K .......... .......... .......... .......... .......... 58% 410M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42750K .......... .......... .......... .......... .......... 58% 359M 0s 2019-12-11T13:56:02.153 INFO:teuthology.orchestra.run.smithi073.stderr: 42800K .......... .......... .......... .......... .......... 58% 412M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 42850K .......... .......... .......... .......... .......... 58% 399M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 42900K .......... .......... .......... .......... .......... 58% 372M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 42950K .......... .......... .......... .......... .......... 58% 325M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 43000K .......... .......... .......... .......... .......... 58% 391M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 43050K .......... .......... .......... .......... .......... 58% 393M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 43100K .......... .......... .......... .......... .......... 58% 394M 0s 2019-12-11T13:56:02.154 INFO:teuthology.orchestra.run.smithi073.stderr: 43150K .......... .......... .......... .......... .......... 58% 346M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43200K .......... .......... .......... .......... .......... 58% 388M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43250K .......... .......... .......... .......... .......... 58% 389M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43300K .......... .......... .......... .......... .......... 58% 406M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43350K .......... .......... .......... .......... .......... 59% 357M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43400K .......... .......... .......... .......... .......... 59% 418M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43450K .......... .......... .......... .......... .......... 59% 423M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43500K .......... .......... .......... .......... .......... 59% 431M 0s 2019-12-11T13:56:02.155 INFO:teuthology.orchestra.run.smithi073.stderr: 43550K .......... .......... .......... .......... .......... 59% 371M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43600K .......... .......... .......... .......... .......... 59% 428M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43650K .......... .......... .......... .......... .......... 59% 20.2M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43700K .......... .......... .......... .......... .......... 59% 261M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43750K .......... .......... .......... .......... .......... 59% 250M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43800K .......... .......... .......... .......... .......... 59% 351M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43850K .......... .......... .......... .......... .......... 59% 328M 0s 2019-12-11T13:56:02.156 INFO:teuthology.orchestra.run.smithi073.stderr: 43900K .......... .......... .......... .......... .......... 59% 325M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 43950K .......... .......... .......... .......... .......... 59% 308M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44000K .......... .......... .......... .......... .......... 59% 364M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44050K .......... .......... .......... .......... .......... 59% 352M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44100K .......... .......... .......... .......... .......... 60% 325M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44150K .......... .......... .......... .......... .......... 60% 300M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44200K .......... .......... .......... .......... .......... 60% 397M 0s 2019-12-11T13:56:02.157 INFO:teuthology.orchestra.run.smithi073.stderr: 44250K .......... .......... .......... .......... .......... 60% 366M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44300K .......... .......... .......... .......... .......... 60% 375M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44350K .......... .......... .......... .......... .......... 60% 344M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44400K .......... .......... .......... .......... .......... 60% 364M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44450K .......... .......... .......... .......... .......... 60% 367M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44500K .......... .......... .......... .......... .......... 60% 371M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44550K .......... .......... .......... .......... .......... 60% 317M 0s 2019-12-11T13:56:02.158 INFO:teuthology.orchestra.run.smithi073.stderr: 44600K .......... .......... .......... .......... .......... 60% 377M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44650K .......... .......... .......... .......... .......... 60% 372M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44700K .......... .......... .......... .......... .......... 60% 361M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44750K .......... .......... .......... .......... .......... 60% 319M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44800K .......... .......... .......... .......... .......... 60% 312M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44850K .......... .......... .......... .......... .......... 61% 344M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44900K .......... .......... .......... .......... .......... 61% 371M 0s 2019-12-11T13:56:02.159 INFO:teuthology.orchestra.run.smithi073.stderr: 44950K .......... .......... .......... .......... .......... 61% 281M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45000K .......... .......... .......... .......... .......... 61% 368M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45050K .......... .......... .......... .......... .......... 61% 382M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45100K .......... .......... .......... .......... .......... 61% 388M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45150K .......... .......... .......... .......... .......... 61% 360M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45200K .......... .......... .......... .......... .......... 61% 390M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45250K .......... .......... .......... .......... .......... 61% 404M 0s 2019-12-11T13:56:02.160 INFO:teuthology.orchestra.run.smithi073.stderr: 45300K .......... .......... .......... .......... .......... 61% 416M 0s 2019-12-11T13:56:02.161 INFO:teuthology.orchestra.run.smithi073.stderr: 45350K .......... .......... .......... .......... .......... 61% 311M 0s 2019-12-11T13:56:02.161 INFO:teuthology.orchestra.run.smithi073.stderr: 45400K .......... .......... .......... .......... .......... 61% 358M 0s 2019-12-11T13:56:02.161 INFO:teuthology.orchestra.run.smithi073.stderr: 45450K .......... .......... .......... .......... .......... 61% 388M 0s 2019-12-11T13:56:02.161 INFO:teuthology.orchestra.run.smithi073.stderr: 45500K .......... .......... .......... .......... .......... 61% 370M 0s 2019-12-11T13:56:02.161 INFO:teuthology.orchestra.run.smithi073.stderr: 45550K .......... .......... .......... .......... .......... 61% 339M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45600K .......... .......... .......... .......... .......... 62% 414M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45650K .......... .......... .......... .......... .......... 62% 416M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45700K .......... .......... .......... .......... .......... 62% 408M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45750K .......... .......... .......... .......... .......... 62% 341M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45800K .......... .......... .......... .......... .......... 62% 424M 0s 2019-12-11T13:56:02.162 INFO:teuthology.orchestra.run.smithi073.stderr: 45850K .......... .......... .......... .......... .......... 62% 416M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 45900K .......... .......... .......... .......... .......... 62% 425M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 45950K .......... .......... .......... .......... .......... 62% 379M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46000K .......... .......... .......... .......... .......... 62% 427M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46050K .......... .......... .......... .......... .......... 62% 434M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46100K .......... .......... .......... .......... .......... 62% 427M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46150K .......... .......... .......... .......... .......... 62% 351M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46200K .......... .......... .......... .......... .......... 62% 429M 0s 2019-12-11T13:56:02.163 INFO:teuthology.orchestra.run.smithi073.stderr: 46250K .......... .......... .......... .......... .......... 62% 433M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46300K .......... .......... .......... .......... .......... 63% 429M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46350K .......... .......... .......... .......... .......... 63% 26.4M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46400K .......... .......... .......... .......... .......... 63% 332M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46450K .......... .......... .......... .......... .......... 63% 325M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46500K .......... .......... .......... .......... .......... 63% 350M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46550K .......... .......... .......... .......... .......... 63% 234M 0s 2019-12-11T13:56:02.164 INFO:teuthology.orchestra.run.smithi073.stderr: 46600K .......... .......... .......... .......... .......... 63% 228M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46650K .......... .......... .......... .......... .......... 63% 241M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46700K .......... .......... .......... .......... .......... 63% 197M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46750K .......... .......... .......... .......... .......... 63% 207M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46800K .......... .......... .......... .......... .......... 63% 259M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46850K .......... .......... .......... .......... .......... 63% 210M 0s 2019-12-11T13:56:02.165 INFO:teuthology.orchestra.run.smithi073.stderr: 46900K .......... .......... .......... .......... .......... 63% 296M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 46950K .......... .......... .......... .......... .......... 63% 245M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 47000K .......... .......... .......... .......... .......... 63% 294M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 47050K .......... .......... .......... .......... .......... 64% 371M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 47100K .......... .......... .......... .......... .......... 64% 259M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 47150K .......... .......... .......... .......... .......... 64% 213M 0s 2019-12-11T13:56:02.166 INFO:teuthology.orchestra.run.smithi073.stderr: 47200K .......... .......... .......... .......... .......... 64% 153M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47250K .......... .......... .......... .......... .......... 64% 332M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47300K .......... .......... .......... .......... .......... 64% 338M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47350K .......... .......... .......... .......... .......... 64% 299M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47400K .......... .......... .......... .......... .......... 64% 373M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47450K .......... .......... .......... .......... .......... 64% 356M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47500K .......... .......... .......... .......... .......... 64% 385M 0s 2019-12-11T13:56:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 47550K .......... .......... .......... .......... .......... 64% 263M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47600K .......... .......... .......... .......... .......... 64% 363M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47650K .......... .......... .......... .......... .......... 64% 356M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47700K .......... .......... .......... .......... .......... 64% 270M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47750K .......... .......... .......... .......... .......... 64% 296M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47800K .......... .......... .......... .......... .......... 65% 329M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47850K .......... .......... .......... .......... .......... 65% 296M 0s 2019-12-11T13:56:02.168 INFO:teuthology.orchestra.run.smithi073.stderr: 47900K .......... .......... .......... .......... .......... 65% 306M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 47950K .......... .......... .......... .......... .......... 65% 335M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48000K .......... .......... .......... .......... .......... 65% 374M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48050K .......... .......... .......... .......... .......... 65% 306M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48100K .......... .......... .......... .......... .......... 65% 361M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48150K .......... .......... .......... .......... .......... 65% 241M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48200K .......... .......... .......... .......... .......... 65% 320M 0s 2019-12-11T13:56:02.169 INFO:teuthology.orchestra.run.smithi073.stderr: 48250K .......... .......... .......... .......... .......... 65% 306M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48300K .......... .......... .......... .......... .......... 65% 350M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48350K .......... .......... .......... .......... .......... 65% 282M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48400K .......... .......... .......... .......... .......... 65% 324M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48450K .......... .......... .......... .......... .......... 65% 248M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48500K .......... .......... .......... .......... .......... 66% 420M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48550K .......... .......... .......... .......... .......... 66% 308M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48600K .......... .......... .......... .......... .......... 66% 263M 0s 2019-12-11T13:56:02.170 INFO:teuthology.orchestra.run.smithi073.stderr: 48650K .......... .......... .......... .......... .......... 66% 320M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48700K .......... .......... .......... .......... .......... 66% 326M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48750K .......... .......... .......... .......... .......... 66% 345M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48800K .......... .......... .......... .......... .......... 66% 305M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48850K .......... .......... .......... .......... .......... 66% 288M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48900K .......... .......... .......... .......... .......... 66% 335M 0s 2019-12-11T13:56:02.171 INFO:teuthology.orchestra.run.smithi073.stderr: 48950K .......... .......... .......... .......... .......... 66% 271M 0s 2019-12-11T13:56:02.172 INFO:teuthology.orchestra.run.smithi073.stderr: 49000K .......... .......... .......... .......... .......... 66% 284M 0s 2019-12-11T13:56:02.172 INFO:teuthology.orchestra.run.smithi073.stderr: 49050K .......... .......... .......... .......... .......... 66% 394M 0s 2019-12-11T13:56:02.172 INFO:teuthology.orchestra.run.smithi073.stderr: 49100K .......... .......... .......... .......... .......... 66% 311M 0s 2019-12-11T13:56:02.172 INFO:teuthology.orchestra.run.smithi073.stderr: 49150K .......... .......... .......... .......... .......... 66% 252M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49200K .......... .......... .......... .......... .......... 66% 263M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49250K .......... .......... .......... .......... .......... 67% 309M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49300K .......... .......... .......... .......... .......... 67% 169M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49350K .......... .......... .......... .......... .......... 67% 153M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49400K .......... .......... .......... .......... .......... 67% 154M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49450K .......... .......... .......... .......... .......... 67% 222M 0s 2019-12-11T13:56:02.173 INFO:teuthology.orchestra.run.smithi073.stderr: 49500K .......... .......... .......... .......... .......... 67% 191M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49550K .......... .......... .......... .......... .......... 67% 238M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49600K .......... .......... .......... .......... .......... 67% 228M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49650K .......... .......... .......... .......... .......... 67% 305M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49700K .......... .......... .......... .......... .......... 67% 339M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49750K .......... .......... .......... .......... .......... 67% 245M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49800K .......... .......... .......... .......... .......... 67% 337M 0s 2019-12-11T13:56:02.174 INFO:teuthology.orchestra.run.smithi073.stderr: 49850K .......... .......... .......... .......... .......... 67% 344M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 49900K .......... .......... .......... .......... .......... 67% 346M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 49950K .......... .......... .......... .......... .......... 67% 343M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50000K .......... .......... .......... .......... .......... 68% 357M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50050K .......... .......... .......... .......... .......... 68% 405M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50100K .......... .......... .......... .......... .......... 68% 409M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50150K .......... .......... .......... .......... .......... 68% 352M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50200K .......... .......... .......... .......... .......... 68% 379M 0s 2019-12-11T13:56:02.175 INFO:teuthology.orchestra.run.smithi073.stderr: 50250K .......... .......... .......... .......... .......... 68% 427M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50300K .......... .......... .......... .......... .......... 68% 357M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50350K .......... .......... .......... .......... .......... 68% 256M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50400K .......... .......... .......... .......... .......... 68% 371M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50450K .......... .......... .......... .......... .......... 68% 379M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50500K .......... .......... .......... .......... .......... 68% 383M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50550K .......... .......... .......... .......... .......... 68% 334M 0s 2019-12-11T13:56:02.176 INFO:teuthology.orchestra.run.smithi073.stderr: 50600K .......... .......... .......... .......... .......... 68% 379M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50650K .......... .......... .......... .......... .......... 68% 370M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50700K .......... .......... .......... .......... .......... 68% 380M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50750K .......... .......... .......... .......... .......... 69% 344M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50800K .......... .......... .......... .......... .......... 69% 393M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50850K .......... .......... .......... .......... .......... 69% 389M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50900K .......... .......... .......... .......... .......... 69% 384M 0s 2019-12-11T13:56:02.177 INFO:teuthology.orchestra.run.smithi073.stderr: 50950K .......... .......... .......... .......... .......... 69% 337M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51000K .......... .......... .......... .......... .......... 69% 375M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51050K .......... .......... .......... .......... .......... 69% 408M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51100K .......... .......... .......... .......... .......... 69% 410M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51150K .......... .......... .......... .......... .......... 69% 373M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51200K .......... .......... .......... .......... .......... 69% 439M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51250K .......... .......... .......... .......... .......... 69% 430M 0s 2019-12-11T13:56:02.178 INFO:teuthology.orchestra.run.smithi073.stderr: 51300K .......... .......... .......... .......... .......... 69% 314M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51350K .......... .......... .......... .......... .......... 69% 222M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51400K .......... .......... .......... .......... .......... 69% 379M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51450K .......... .......... .......... .......... .......... 70% 261M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51500K .......... .......... .......... .......... .......... 70% 387M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51550K .......... .......... .......... .......... .......... 70% 169M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51600K .......... .......... .......... .......... .......... 70% 419M 0s 2019-12-11T13:56:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 51650K .......... .......... .......... .......... .......... 70% 374M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51700K .......... .......... .......... .......... .......... 70% 399M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51750K .......... .......... .......... .......... .......... 70% 192M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51800K .......... .......... .......... .......... .......... 70% 309M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51850K .......... .......... .......... .......... .......... 70% 377M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51900K .......... .......... .......... .......... .......... 70% 365M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 51950K .......... .......... .......... .......... .......... 70% 309M 0s 2019-12-11T13:56:02.180 INFO:teuthology.orchestra.run.smithi073.stderr: 52000K .......... .......... .......... .......... .......... 70% 371M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52050K .......... .......... .......... .......... .......... 70% 387M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52100K .......... .......... .......... .......... .......... 70% 393M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52150K .......... .......... .......... .......... .......... 70% 307M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52200K .......... .......... .......... .......... .......... 71% 242M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52250K .......... .......... .......... .......... .......... 71% 244M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52300K .......... .......... .......... .......... .......... 71% 277M 0s 2019-12-11T13:56:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 52350K .......... .......... .......... .......... .......... 71% 239M 0s 2019-12-11T13:56:02.182 INFO:teuthology.orchestra.run.smithi073.stderr: 52400K .......... .......... .......... .......... .......... 71% 294M 0s 2019-12-11T13:56:02.182 INFO:teuthology.orchestra.run.smithi073.stderr: 52450K .......... .......... .......... .......... .......... 71% 318M 0s 2019-12-11T13:56:02.182 INFO:teuthology.orchestra.run.smithi073.stderr: 52500K .......... .......... .......... .......... .......... 71% 320M 0s 2019-12-11T13:56:02.182 INFO:teuthology.orchestra.run.smithi073.stderr: 52550K .......... .......... .......... .......... .......... 71% 259M 0s 2019-12-11T13:56:02.182 INFO:teuthology.orchestra.run.smithi073.stderr: 52600K .......... .......... .......... .......... .......... 71% 311M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52650K .......... .......... .......... .......... .......... 71% 304M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52700K .......... .......... .......... .......... .......... 71% 303M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52750K .......... .......... .......... .......... .......... 71% 279M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52800K .......... .......... .......... .......... .......... 71% 310M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52850K .......... .......... .......... .......... .......... 71% 323M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52900K .......... .......... .......... .......... .......... 71% 305M 0s 2019-12-11T13:56:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 52950K .......... .......... .......... .......... .......... 72% 260M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53000K .......... .......... .......... .......... .......... 72% 304M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53050K .......... .......... .......... .......... .......... 72% 304M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53100K .......... .......... .......... .......... .......... 72% 323M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53150K .......... .......... .......... .......... .......... 72% 305M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53200K .......... .......... .......... .......... .......... 72% 436M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53250K .......... .......... .......... .......... .......... 72% 419M 0s 2019-12-11T13:56:02.184 INFO:teuthology.orchestra.run.smithi073.stderr: 53300K .......... .......... .......... .......... .......... 72% 437M 0s 2019-12-11T13:56:02.185 INFO:teuthology.orchestra.run.smithi073.stderr: 53350K .......... .......... .......... .......... .......... 72% 351M 0s 2019-12-11T13:56:02.185 INFO:teuthology.orchestra.run.smithi073.stderr: 53400K .......... .......... .......... .......... .......... 72% 267M 0s 2019-12-11T13:56:02.185 INFO:teuthology.orchestra.run.smithi073.stderr: 53450K .......... .......... .......... .......... .......... 72% 353M 0s 2019-12-11T13:56:02.185 INFO:teuthology.orchestra.run.smithi073.stderr: 53500K .......... .......... .......... .......... .......... 72% 378M 0s 2019-12-11T13:56:02.185 INFO:teuthology.orchestra.run.smithi073.stderr: 53550K .......... .......... .......... .......... .......... 72% 289M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53600K .......... .......... .......... .......... .......... 72% 371M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53650K .......... .......... .......... .......... .......... 73% 397M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53700K .......... .......... .......... .......... .......... 73% 286M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53750K .......... .......... .......... .......... .......... 73% 273M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53800K .......... .......... .......... .......... .......... 73% 281M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53850K .......... .......... .......... .......... .......... 73% 307M 0s 2019-12-11T13:56:02.186 INFO:teuthology.orchestra.run.smithi073.stderr: 53900K .......... .......... .......... .......... .......... 73% 363M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 53950K .......... .......... .......... .......... .......... 73% 322M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54000K .......... .......... .......... .......... .......... 73% 256M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54050K .......... .......... .......... .......... .......... 73% 236M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54100K .......... .......... .......... .......... .......... 73% 362M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54150K .......... .......... .......... .......... .......... 73% 317M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54200K .......... .......... .......... .......... .......... 73% 368M 0s 2019-12-11T13:56:02.187 INFO:teuthology.orchestra.run.smithi073.stderr: 54250K .......... .......... .......... .......... .......... 73% 293M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54300K .......... .......... .......... .......... .......... 73% 363M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54350K .......... .......... .......... .......... .......... 73% 265M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54400K .......... .......... .......... .......... .......... 74% 375M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54450K .......... .......... .......... .......... .......... 74% 317M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54500K .......... .......... .......... .......... .......... 74% 281M 0s 2019-12-11T13:56:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 54550K .......... .......... .......... .......... .......... 74% 242M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54600K .......... .......... .......... .......... .......... 74% 357M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54650K .......... .......... .......... .......... .......... 74% 385M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54700K .......... .......... .......... .......... .......... 74% 297M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54750K .......... .......... .......... .......... .......... 74% 322M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54800K .......... .......... .......... .......... .......... 74% 332M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54850K .......... .......... .......... .......... .......... 74% 387M 0s 2019-12-11T13:56:02.189 INFO:teuthology.orchestra.run.smithi073.stderr: 54900K .......... .......... .......... .......... .......... 74% 246M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 54950K .......... .......... .......... .......... .......... 74% 296M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55000K .......... .......... .......... .......... .......... 74% 361M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55050K .......... .......... .......... .......... .......... 74% 394M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55100K .......... .......... .......... .......... .......... 74% 345M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55150K .......... .......... .......... .......... .......... 75% 288M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55200K .......... .......... .......... .......... .......... 75% 349M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55250K .......... .......... .......... .......... .......... 75% 301M 0s 2019-12-11T13:56:02.190 INFO:teuthology.orchestra.run.smithi073.stderr: 55300K .......... .......... .......... .......... .......... 75% 286M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55350K .......... .......... .......... .......... .......... 75% 282M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55400K .......... .......... .......... .......... .......... 75% 375M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55450K .......... .......... .......... .......... .......... 75% 313M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55500K .......... .......... .......... .......... .......... 75% 290M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55550K .......... .......... .......... .......... .......... 75% 235M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55600K .......... .......... .......... .......... .......... 75% 306M 0s 2019-12-11T13:56:02.191 INFO:teuthology.orchestra.run.smithi073.stderr: 55650K .......... .......... .......... .......... .......... 75% 340M 0s 2019-12-11T13:56:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 55700K .......... .......... .......... .......... .......... 75% 349M 0s 2019-12-11T13:56:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 55750K .......... .......... .......... .......... .......... 75% 297M 0s 2019-12-11T13:56:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 55800K .......... .......... .......... .......... .......... 75% 337M 0s 2019-12-11T13:56:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 55850K .......... .......... .......... .......... .......... 75% 270M 0s 2019-12-11T13:56:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 55900K .......... .......... .......... .......... .......... 76% 345M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 55950K .......... .......... .......... .......... .......... 76% 315M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56000K .......... .......... .......... .......... .......... 76% 334M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56050K .......... .......... .......... .......... .......... 76% 328M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56100K .......... .......... .......... .......... .......... 76% 363M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56150K .......... .......... .......... .......... .......... 76% 289M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56200K .......... .......... .......... .......... .......... 76% 324M 0s 2019-12-11T13:56:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 56250K .......... .......... .......... .......... .......... 76% 259M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56300K .......... .......... .......... .......... .......... 76% 185M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56350K .......... .......... .......... .......... .......... 76% 180M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56400K .......... .......... .......... .......... .......... 76% 194M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56450K .......... .......... .......... .......... .......... 76% 205M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56500K .......... .......... .......... .......... .......... 76% 266M 0s 2019-12-11T13:56:02.195 INFO:teuthology.orchestra.run.smithi073.stderr: 56550K .......... .......... .......... .......... .......... 76% 302M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56600K .......... .......... .......... .......... .......... 77% 378M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56650K .......... .......... .......... .......... .......... 77% 403M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56700K .......... .......... .......... .......... .......... 77% 365M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56750K .......... .......... .......... .......... .......... 77% 268M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56800K .......... .......... .......... .......... .......... 77% 199M 0s 2019-12-11T13:56:02.196 INFO:teuthology.orchestra.run.smithi073.stderr: 56850K .......... .......... .......... .......... .......... 77% 206M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 56900K .......... .......... .......... .......... .......... 77% 226M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 56950K .......... .......... .......... .......... .......... 77% 192M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 57000K .......... .......... .......... .......... .......... 77% 232M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 57050K .......... .......... .......... .......... .......... 77% 244M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 57100K .......... .......... .......... .......... .......... 77% 391M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 57150K .......... .......... .......... .......... .......... 77% 351M 0s 2019-12-11T13:56:02.197 INFO:teuthology.orchestra.run.smithi073.stderr: 57200K .......... .......... .......... .......... .......... 77% 404M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57250K .......... .......... .......... .......... .......... 77% 411M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57300K .......... .......... .......... .......... .......... 77% 368M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57350K .......... .......... .......... .......... .......... 78% 345M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57400K .......... .......... .......... .......... .......... 78% 421M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57450K .......... .......... .......... .......... .......... 78% 290M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57500K .......... .......... .......... .......... .......... 78% 255M 0s 2019-12-11T13:56:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 57550K .......... .......... .......... .......... .......... 78% 218M 0s 2019-12-11T13:56:02.199 INFO:teuthology.orchestra.run.smithi073.stderr: 57600K .......... .......... .......... .......... .......... 78% 251M 0s 2019-12-11T13:56:02.199 INFO:teuthology.orchestra.run.smithi073.stderr: 57650K .......... .......... .......... .......... .......... 78% 235M 0s 2019-12-11T13:56:02.199 INFO:teuthology.orchestra.run.smithi073.stderr: 57700K .......... .......... .......... .......... .......... 78% 277M 0s 2019-12-11T13:56:02.199 INFO:teuthology.orchestra.run.smithi073.stderr: 57750K .......... .......... .......... .......... .......... 78% 205M 0s 2019-12-11T13:56:02.200 INFO:teuthology.orchestra.run.smithi073.stderr: 57800K .......... .......... .......... .......... .......... 78% 234M 0s 2019-12-11T13:56:02.200 INFO:teuthology.orchestra.run.smithi073.stderr: 57850K .......... .......... .......... .......... .......... 78% 358M 0s 2019-12-11T13:56:02.200 INFO:teuthology.orchestra.run.smithi073.stderr: 57900K .......... .......... .......... .......... .......... 78% 290M 0s 2019-12-11T13:56:02.200 INFO:teuthology.orchestra.run.smithi073.stderr: 57950K .......... .......... .......... .......... .......... 78% 217M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58000K .......... .......... .......... .......... .......... 78% 228M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58050K .......... .......... .......... .......... .......... 78% 278M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58100K .......... .......... .......... .......... .......... 79% 398M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58150K .......... .......... .......... .......... .......... 79% 341M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58200K .......... .......... .......... .......... .......... 79% 445M 0s 2019-12-11T13:56:02.201 INFO:teuthology.orchestra.run.smithi073.stderr: 58250K .......... .......... .......... .......... .......... 79% 432M 0s 2019-12-11T13:56:02.202 INFO:teuthology.orchestra.run.smithi073.stderr: 58300K .......... .......... .......... .......... .......... 79% 416M 0s 2019-12-11T13:56:02.202 INFO:teuthology.orchestra.run.smithi073.stderr: 58350K .......... .......... .......... .......... .......... 79% 349M 0s 2019-12-11T13:56:02.202 INFO:teuthology.orchestra.run.smithi073.stderr: 58400K .......... .......... .......... .......... .......... 79% 413M 0s 2019-12-11T13:56:02.203 INFO:teuthology.orchestra.run.smithi073.stderr: 58450K .......... .......... .......... .......... .......... 79% 423M 0s 2019-12-11T13:56:02.203 INFO:teuthology.orchestra.run.smithi073.stderr: 58500K .......... .......... .......... .......... .......... 79% 415M 0s 2019-12-11T13:56:02.203 INFO:teuthology.orchestra.run.smithi073.stderr: 58550K .......... .......... .......... .......... .......... 79% 338M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58600K .......... .......... .......... .......... .......... 79% 415M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58650K .......... .......... .......... .......... .......... 79% 425M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58700K .......... .......... .......... .......... .......... 79% 421M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58750K .......... .......... .......... .......... .......... 79% 378M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58800K .......... .......... .......... .......... .......... 80% 413M 0s 2019-12-11T13:56:02.204 INFO:teuthology.orchestra.run.smithi073.stderr: 58850K .......... .......... .......... .......... .......... 80% 411M 0s 2019-12-11T13:56:02.205 INFO:teuthology.orchestra.run.smithi073.stderr: 58900K .......... .......... .......... .......... .......... 80% 420M 0s 2019-12-11T13:56:02.205 INFO:teuthology.orchestra.run.smithi073.stderr: 58950K .......... .......... .......... .......... .......... 80% 337M 0s 2019-12-11T13:56:02.205 INFO:teuthology.orchestra.run.smithi073.stderr: 59000K .......... .......... .......... .......... .......... 80% 411M 0s 2019-12-11T13:56:02.205 INFO:teuthology.orchestra.run.smithi073.stderr: 59050K .......... .......... .......... .......... .......... 80% 423M 0s 2019-12-11T13:56:02.205 INFO:teuthology.orchestra.run.smithi073.stderr: 59100K .......... .......... .......... .......... .......... 80% 421M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59150K .......... .......... .......... .......... .......... 80% 371M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59200K .......... .......... .......... .......... .......... 80% 365M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59250K .......... .......... .......... .......... .......... 80% 258M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59300K .......... .......... .......... .......... .......... 80% 415M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59350K .......... .......... .......... .......... .......... 80% 365M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59400K .......... .......... .......... .......... .......... 80% 427M 0s 2019-12-11T13:56:02.206 INFO:teuthology.orchestra.run.smithi073.stderr: 59450K .......... .......... .......... .......... .......... 80% 441M 0s 2019-12-11T13:56:02.207 INFO:teuthology.orchestra.run.smithi073.stderr: 59500K .......... .......... .......... .......... .......... 80% 444M 0s 2019-12-11T13:56:02.207 INFO:teuthology.orchestra.run.smithi073.stderr: 59550K .......... .......... .......... .......... .......... 81% 394M 0s 2019-12-11T13:56:02.207 INFO:teuthology.orchestra.run.smithi073.stderr: 59600K .......... .......... .......... .......... .......... 81% 444M 0s 2019-12-11T13:56:02.207 INFO:teuthology.orchestra.run.smithi073.stderr: 59650K .......... .......... .......... .......... .......... 81% 415M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59700K .......... .......... .......... .......... .......... 81% 430M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59750K .......... .......... .......... .......... .......... 81% 314M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59800K .......... .......... .......... .......... .......... 81% 423M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59850K .......... .......... .......... .......... .......... 81% 440M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59900K .......... .......... .......... .......... .......... 81% 323M 0s 2019-12-11T13:56:02.208 INFO:teuthology.orchestra.run.smithi073.stderr: 59950K .......... .......... .......... .......... .......... 81% 326M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60000K .......... .......... .......... .......... .......... 81% 195M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60050K .......... .......... .......... .......... .......... 81% 321M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60100K .......... .......... .......... .......... .......... 81% 359M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60150K .......... .......... .......... .......... .......... 81% 295M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60200K .......... .......... .......... .......... .......... 81% 344M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60250K .......... .......... .......... .......... .......... 81% 191M 0s 2019-12-11T13:56:02.209 INFO:teuthology.orchestra.run.smithi073.stderr: 60300K .......... .......... .......... .......... .......... 82% 196M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60350K .......... .......... .......... .......... .......... 82% 174M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60400K .......... .......... .......... .......... .......... 82% 263M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60450K .......... .......... .......... .......... .......... 82% 361M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60500K .......... .......... .......... .......... .......... 82% 384M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60550K .......... .......... .......... .......... .......... 82% 311M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60600K .......... .......... .......... .......... .......... 82% 331M 0s 2019-12-11T13:56:02.210 INFO:teuthology.orchestra.run.smithi073.stderr: 60650K .......... .......... .......... .......... .......... 82% 225M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60700K .......... .......... .......... .......... .......... 82% 249M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60750K .......... .......... .......... .......... .......... 82% 246M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60800K .......... .......... .......... .......... .......... 82% 382M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60850K .......... .......... .......... .......... .......... 82% 442M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60900K .......... .......... .......... .......... .......... 82% 421M 0s 2019-12-11T13:56:02.211 INFO:teuthology.orchestra.run.smithi073.stderr: 60950K .......... .......... .......... .......... .......... 82% 333M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61000K .......... .......... .......... .......... .......... 82% 404M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61050K .......... .......... .......... .......... .......... 83% 399M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61100K .......... .......... .......... .......... .......... 83% 393M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61150K .......... .......... .......... .......... .......... 83% 340M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61200K .......... .......... .......... .......... .......... 83% 349M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61250K .......... .......... .......... .......... .......... 83% 371M 0s 2019-12-11T13:56:02.212 INFO:teuthology.orchestra.run.smithi073.stderr: 61300K .......... .......... .......... .......... .......... 83% 351M 0s 2019-12-11T13:56:02.213 INFO:teuthology.orchestra.run.smithi073.stderr: 61350K .......... .......... .......... .......... .......... 83% 291M 0s 2019-12-11T13:56:02.213 INFO:teuthology.orchestra.run.smithi073.stderr: 61400K .......... .......... .......... .......... .......... 83% 322M 0s 2019-12-11T13:56:02.214 INFO:teuthology.orchestra.run.smithi073.stderr: 61450K .......... .......... .......... .......... .......... 83% 358M 0s 2019-12-11T13:56:02.214 INFO:teuthology.orchestra.run.smithi073.stderr: 61500K .......... .......... .......... .......... .......... 83% 324M 0s 2019-12-11T13:56:02.214 INFO:teuthology.orchestra.run.smithi073.stderr: 61550K .......... .......... .......... .......... .......... 83% 262M 0s 2019-12-11T13:56:02.214 INFO:teuthology.orchestra.run.smithi073.stderr: 61600K .......... .......... .......... .......... .......... 83% 386M 0s 2019-12-11T13:56:02.214 INFO:teuthology.orchestra.run.smithi073.stderr: 61650K .......... .......... .......... .......... .......... 83% 258M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61700K .......... .......... .......... .......... .......... 83% 282M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61750K .......... .......... .......... .......... .......... 84% 230M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61800K .......... .......... .......... .......... .......... 84% 267M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61850K .......... .......... .......... .......... .......... 84% 264M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61900K .......... .......... .......... .......... .......... 84% 242M 0s 2019-12-11T13:56:02.215 INFO:teuthology.orchestra.run.smithi073.stderr: 61950K .......... .......... .......... .......... .......... 84% 220M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62000K .......... .......... .......... .......... .......... 84% 241M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62050K .......... .......... .......... .......... .......... 84% 263M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62100K .......... .......... .......... .......... .......... 84% 284M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62150K .......... .......... .......... .......... .......... 84% 227M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62200K .......... .......... .......... .......... .......... 84% 237M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62250K .......... .......... .......... .......... .......... 84% 252M 0s 2019-12-11T13:56:02.216 INFO:teuthology.orchestra.run.smithi073.stderr: 62300K .......... .......... .......... .......... .......... 84% 379M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62350K .......... .......... .......... .......... .......... 84% 352M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62400K .......... .......... .......... .......... .......... 84% 394M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62450K .......... .......... .......... .......... .......... 84% 397M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62500K .......... .......... .......... .......... .......... 85% 361M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62550K .......... .......... .......... .......... .......... 85% 314M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62600K .......... .......... .......... .......... .......... 85% 359M 0s 2019-12-11T13:56:02.217 INFO:teuthology.orchestra.run.smithi073.stderr: 62650K .......... .......... .......... .......... .......... 85% 402M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62700K .......... .......... .......... .......... .......... 85% 367M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62750K .......... .......... .......... .......... .......... 85% 349M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62800K .......... .......... .......... .......... .......... 85% 400M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62850K .......... .......... .......... .......... .......... 85% 351M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62900K .......... .......... .......... .......... .......... 85% 391M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 62950K .......... .......... .......... .......... .......... 85% 309M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 63000K .......... .......... .......... .......... .......... 85% 260M 0s 2019-12-11T13:56:02.218 INFO:teuthology.orchestra.run.smithi073.stderr: 63050K .......... .......... .......... .......... .......... 85% 247M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63100K .......... .......... .......... .......... .......... 85% 252M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63150K .......... .......... .......... .......... .......... 85% 243M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63200K .......... .......... .......... .......... .......... 85% 376M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63250K .......... .......... .......... .......... .......... 86% 398M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63300K .......... .......... .......... .......... .......... 86% 397M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63350K .......... .......... .......... .......... .......... 86% 243M 0s 2019-12-11T13:56:02.219 INFO:teuthology.orchestra.run.smithi073.stderr: 63400K .......... .......... .......... .......... .......... 86% 322M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63450K .......... .......... .......... .......... .......... 86% 326M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63500K .......... .......... .......... .......... .......... 86% 266M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63550K .......... .......... .......... .......... .......... 86% 333M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63600K .......... .......... .......... .......... .......... 86% 261M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63650K .......... .......... .......... .......... .......... 86% 256M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63700K .......... .......... .......... .......... .......... 86% 369M 0s 2019-12-11T13:56:02.220 INFO:teuthology.orchestra.run.smithi073.stderr: 63750K .......... .......... .......... .......... .......... 86% 206M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 63800K .......... .......... .......... .......... .......... 86% 351M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 63850K .......... .......... .......... .......... .......... 86% 287M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 63900K .......... .......... .......... .......... .......... 86% 256M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 63950K .......... .......... .......... .......... .......... 87% 259M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 64000K .......... .......... .......... .......... .......... 87% 316M 0s 2019-12-11T13:56:02.221 INFO:teuthology.orchestra.run.smithi073.stderr: 64050K .......... .......... .......... .......... .......... 87% 243M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64100K .......... .......... .......... .......... .......... 87% 329M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64150K .......... .......... .......... .......... .......... 87% 324M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64200K .......... .......... .......... .......... .......... 87% 396M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64250K .......... .......... .......... .......... .......... 87% 410M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64300K .......... .......... .......... .......... .......... 87% 341M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64350K .......... .......... .......... .......... .......... 87% 360M 0s 2019-12-11T13:56:02.222 INFO:teuthology.orchestra.run.smithi073.stderr: 64400K .......... .......... .......... .......... .......... 87% 343M 0s 2019-12-11T13:56:02.223 INFO:teuthology.orchestra.run.smithi073.stderr: 64450K .......... .......... .......... .......... .......... 87% 268M 0s 2019-12-11T13:56:02.223 INFO:teuthology.orchestra.run.smithi073.stderr: 64500K .......... .......... .......... .......... .......... 87% 223M 0s 2019-12-11T13:56:02.223 INFO:teuthology.orchestra.run.smithi073.stderr: 64550K .......... .......... .......... .......... .......... 87% 180M 0s 2019-12-11T13:56:02.223 INFO:teuthology.orchestra.run.smithi073.stderr: 64600K .......... .......... .......... .......... .......... 87% 228M 0s 2019-12-11T13:56:02.223 INFO:teuthology.orchestra.run.smithi073.stderr: 64650K .......... .......... .......... .......... .......... 87% 225M 0s 2019-12-11T13:56:02.224 INFO:teuthology.orchestra.run.smithi073.stderr: 64700K .......... .......... .......... .......... .......... 88% 364M 0s 2019-12-11T13:56:02.224 INFO:teuthology.orchestra.run.smithi073.stderr: 64750K .......... .......... .......... .......... .......... 88% 325M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 64800K .......... .......... .......... .......... .......... 88% 324M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 64850K .......... .......... .......... .......... .......... 88% 326M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 64900K .......... .......... .......... .......... .......... 88% 367M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 64950K .......... .......... .......... .......... .......... 88% 277M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 65000K .......... .......... .......... .......... .......... 88% 283M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 65050K .......... .......... .......... .......... .......... 88% 231M 0s 2019-12-11T13:56:02.225 INFO:teuthology.orchestra.run.smithi073.stderr: 65100K .......... .......... .......... .......... .......... 88% 262M 0s 2019-12-11T13:56:02.226 INFO:teuthology.orchestra.run.smithi073.stderr: 65150K .......... .......... .......... .......... .......... 88% 191M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65200K .......... .......... .......... .......... .......... 88% 184M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65250K .......... .......... .......... .......... .......... 88% 283M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65300K .......... .......... .......... .......... .......... 88% 323M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65350K .......... .......... .......... .......... .......... 88% 251M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65400K .......... .......... .......... .......... .......... 88% 306M 0s 2019-12-11T13:56:02.227 INFO:teuthology.orchestra.run.smithi073.stderr: 65450K .......... .......... .......... .......... .......... 89% 301M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65500K .......... .......... .......... .......... .......... 89% 329M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65550K .......... .......... .......... .......... .......... 89% 236M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65600K .......... .......... .......... .......... .......... 89% 270M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65650K .......... .......... .......... .......... .......... 89% 275M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65700K .......... .......... .......... .......... .......... 89% 285M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65750K .......... .......... .......... .......... .......... 89% 232M 0s 2019-12-11T13:56:02.228 INFO:teuthology.orchestra.run.smithi073.stderr: 65800K .......... .......... .......... .......... .......... 89% 282M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 65850K .......... .......... .......... .......... .......... 89% 292M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 65900K .......... .......... .......... .......... .......... 89% 343M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 65950K .......... .......... .......... .......... .......... 89% 290M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 66000K .......... .......... .......... .......... .......... 89% 388M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 66050K .......... .......... .......... .......... .......... 89% 219M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 66100K .......... .......... .......... .......... .......... 89% 175M 0s 2019-12-11T13:56:02.229 INFO:teuthology.orchestra.run.smithi073.stderr: 66150K .......... .......... .......... .......... .......... 89% 199M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66200K .......... .......... .......... .......... .......... 90% 336M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66250K .......... .......... .......... .......... .......... 90% 354M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66300K .......... .......... .......... .......... .......... 90% 349M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66350K .......... .......... .......... .......... .......... 90% 333M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66400K .......... .......... .......... .......... .......... 90% 366M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66450K .......... .......... .......... .......... .......... 90% 375M 0s 2019-12-11T13:56:02.230 INFO:teuthology.orchestra.run.smithi073.stderr: 66500K .......... .......... .......... .......... .......... 90% 334M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66550K .......... .......... .......... .......... .......... 90% 207M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66600K .......... .......... .......... .......... .......... 90% 332M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66650K .......... .......... .......... .......... .......... 90% 371M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66700K .......... .......... .......... .......... .......... 90% 308M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66750K .......... .......... .......... .......... .......... 90% 310M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66800K .......... .......... .......... .......... .......... 90% 280M 0s 2019-12-11T13:56:02.231 INFO:teuthology.orchestra.run.smithi073.stderr: 66850K .......... .......... .......... .......... .......... 90% 299M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 66900K .......... .......... .......... .......... .......... 91% 305M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 66950K .......... .......... .......... .......... .......... 91% 264M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 67000K .......... .......... .......... .......... .......... 91% 277M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 67050K .......... .......... .......... .......... .......... 91% 320M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 67100K .......... .......... .......... .......... .......... 91% 311M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 67150K .......... .......... .......... .......... .......... 91% 271M 0s 2019-12-11T13:56:02.232 INFO:teuthology.orchestra.run.smithi073.stderr: 67200K .......... .......... .......... .......... .......... 91% 293M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67250K .......... .......... .......... .......... .......... 91% 297M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67300K .......... .......... .......... .......... .......... 91% 347M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67350K .......... .......... .......... .......... .......... 91% 240M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67400K .......... .......... .......... .......... .......... 91% 308M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67450K .......... .......... .......... .......... .......... 91% 270M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67500K .......... .......... .......... .......... .......... 91% 329M 0s 2019-12-11T13:56:02.233 INFO:teuthology.orchestra.run.smithi073.stderr: 67550K .......... .......... .......... .......... .......... 91% 272M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67600K .......... .......... .......... .......... .......... 91% 241M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67650K .......... .......... .......... .......... .......... 92% 191M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67700K .......... .......... .......... .......... .......... 92% 196M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67750K .......... .......... .......... .......... .......... 92% 144M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67800K .......... .......... .......... .......... .......... 92% 257M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67850K .......... .......... .......... .......... .......... 92% 329M 0s 2019-12-11T13:56:02.234 INFO:teuthology.orchestra.run.smithi073.stderr: 67900K .......... .......... .......... .......... .......... 92% 306M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 67950K .......... .......... .......... .......... .......... 92% 249M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68000K .......... .......... .......... .......... .......... 92% 253M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68050K .......... .......... .......... .......... .......... 92% 185M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68100K .......... .......... .......... .......... .......... 92% 202M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68150K .......... .......... .......... .......... .......... 92% 218M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68200K .......... .......... .......... .......... .......... 92% 336M 0s 2019-12-11T13:56:02.235 INFO:teuthology.orchestra.run.smithi073.stderr: 68250K .......... .......... .......... .......... .......... 92% 283M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68300K .......... .......... .......... .......... .......... 92% 306M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68350K .......... .......... .......... .......... .......... 92% 256M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68400K .......... .......... .......... .......... .......... 93% 331M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68450K .......... .......... .......... .......... .......... 93% 202M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68500K .......... .......... .......... .......... .......... 93% 185M 0s 2019-12-11T13:56:02.236 INFO:teuthology.orchestra.run.smithi073.stderr: 68550K .......... .......... .......... .......... .......... 93% 234M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68600K .......... .......... .......... .......... .......... 93% 207M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68650K .......... .......... .......... .......... .......... 93% 297M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68700K .......... .......... .......... .......... .......... 93% 297M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68750K .......... .......... .......... .......... .......... 93% 235M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68800K .......... .......... .......... .......... .......... 93% 279M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68850K .......... .......... .......... .......... .......... 93% 267M 0s 2019-12-11T13:56:02.237 INFO:teuthology.orchestra.run.smithi073.stderr: 68900K .......... .......... .......... .......... .......... 93% 313M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68950K .......... .......... .......... .......... .......... 93% 241M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69000K .......... .......... .......... .......... .......... 93% 264M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69050K .......... .......... .......... .......... .......... 93% 272M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69100K .......... .......... .......... .......... .......... 94% 285M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69150K .......... .......... .......... .......... .......... 94% 289M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69200K .......... .......... .......... .......... .......... 94% 329M 0s 2019-12-11T13:56:02.238 INFO:teuthology.orchestra.run.smithi073.stderr: 69250K .......... .......... .......... .......... .......... 94% 327M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69300K .......... .......... .......... .......... .......... 94% 281M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69350K .......... .......... .......... .......... .......... 94% 258M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69400K .......... .......... .......... .......... .......... 94% 287M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69450K .......... .......... .......... .......... .......... 94% 336M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69500K .......... .......... .......... .......... .......... 94% 293M 0s 2019-12-11T13:56:02.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69550K .......... .......... .......... .......... .......... 94% 272M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69600K .......... .......... .......... .......... .......... 94% 309M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69650K .......... .......... .......... .......... .......... 94% 312M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69700K .......... .......... .......... .......... .......... 94% 348M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69750K .......... .......... .......... .......... .......... 94% 278M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69800K .......... .......... .......... .......... .......... 94% 387M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69850K .......... .......... .......... .......... .......... 95% 375M 0s 2019-12-11T13:56:02.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69900K .......... .......... .......... .......... .......... 95% 364M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69950K .......... .......... .......... .......... .......... 95% 352M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70000K .......... .......... .......... .......... .......... 95% 396M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70050K .......... .......... .......... .......... .......... 95% 375M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70100K .......... .......... .......... .......... .......... 95% 361M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70150K .......... .......... .......... .......... .......... 95% 310M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70200K .......... .......... .......... .......... .......... 95% 370M 0s 2019-12-11T13:56:02.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70250K .......... .......... .......... .......... .......... 95% 336M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70300K .......... .......... .......... .......... .......... 95% 387M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70350K .......... .......... .......... .......... .......... 95% 302M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70400K .......... .......... .......... .......... .......... 95% 356M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70450K .......... .......... .......... .......... .......... 95% 372M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70500K .......... .......... .......... .......... .......... 95% 311M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70550K .......... .......... .......... .......... .......... 95% 231M 0s 2019-12-11T13:56:02.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70600K .......... .......... .......... .......... .......... 96% 283M 0s 2019-12-11T13:56:02.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70650K .......... .......... .......... .......... .......... 96% 276M 0s 2019-12-11T13:56:02.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70700K .......... .......... .......... .......... .......... 96% 277M 0s 2019-12-11T13:56:02.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70750K .......... .......... .......... .......... .......... 96% 278M 0s 2019-12-11T13:56:02.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70800K .......... .......... .......... .......... .......... 96% 303M 0s 2019-12-11T13:56:02.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70850K .......... .......... .......... .......... .......... 96% 289M 0s 2019-12-11T13:56:02.244 INFO:teuthology.orchestra.run.smithi073.stderr: 70900K .......... .......... .......... .......... .......... 96% 291M 0s 2019-12-11T13:56:02.245 INFO:teuthology.orchestra.run.smithi073.stderr: 70950K .......... .......... .......... .......... .......... 96% 252M 0s 2019-12-11T13:56:02.245 INFO:teuthology.orchestra.run.smithi073.stderr: 71000K .......... .......... .......... .......... .......... 96% 322M 0s 2019-12-11T13:56:02.245 INFO:teuthology.orchestra.run.smithi073.stderr: 71050K .......... .......... .......... .......... .......... 96% 301M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71100K .......... .......... .......... .......... .......... 96% 329M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71150K .......... .......... .......... .......... .......... 96% 278M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71200K .......... .......... .......... .......... .......... 96% 296M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71250K .......... .......... .......... .......... .......... 96% 352M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71300K .......... .......... .......... .......... .......... 96% 401M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71350K .......... .......... .......... .......... .......... 97% 341M 0s 2019-12-11T13:56:02.246 INFO:teuthology.orchestra.run.smithi073.stderr: 71400K .......... .......... .......... .......... .......... 97% 414M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71450K .......... .......... .......... .......... .......... 97% 382M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71500K .......... .......... .......... .......... .......... 97% 398M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71550K .......... .......... .......... .......... .......... 97% 361M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71600K .......... .......... .......... .......... .......... 97% 424M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71650K .......... .......... .......... .......... .......... 97% 360M 0s 2019-12-11T13:56:02.247 INFO:teuthology.orchestra.run.smithi073.stderr: 71700K .......... .......... .......... .......... .......... 97% 386M 0s 2019-12-11T13:56:02.248 INFO:teuthology.orchestra.run.smithi073.stderr: 71750K .......... .......... .......... .......... .......... 97% 331M 0s 2019-12-11T13:56:02.248 INFO:teuthology.orchestra.run.smithi073.stderr: 71800K .......... .......... .......... .......... .......... 97% 394M 0s 2019-12-11T13:56:02.248 INFO:teuthology.orchestra.run.smithi073.stderr: 71850K .......... .......... .......... .......... .......... 97% 380M 0s 2019-12-11T13:56:02.248 INFO:teuthology.orchestra.run.smithi073.stderr: 71900K .......... .......... .......... .......... .......... 97% 368M 0s 2019-12-11T13:56:02.248 INFO:teuthology.orchestra.run.smithi073.stderr: 71950K .......... .......... .......... .......... .......... 97% 351M 0s 2019-12-11T13:56:02.249 INFO:teuthology.orchestra.run.smithi073.stderr: 72000K .......... .......... .......... .......... .......... 97% 327M 0s 2019-12-11T13:56:02.249 INFO:teuthology.orchestra.run.smithi073.stderr: 72050K .......... .......... .......... .......... .......... 98% 271M 0s 2019-12-11T13:56:02.249 INFO:teuthology.orchestra.run.smithi073.stderr: 72100K .......... .......... .......... .......... .......... 98% 343M 0s 2019-12-11T13:56:02.249 INFO:teuthology.orchestra.run.smithi073.stderr: 72150K .......... .......... .......... .......... .......... 98% 306M 0s 2019-12-11T13:56:02.249 INFO:teuthology.orchestra.run.smithi073.stderr: 72200K .......... .......... .......... .......... .......... 98% 388M 0s 2019-12-11T13:56:02.250 INFO:teuthology.orchestra.run.smithi073.stderr: 72250K .......... .......... .......... .......... .......... 98% 319M 0s 2019-12-11T13:56:02.250 INFO:teuthology.orchestra.run.smithi073.stderr: 72300K .......... .......... .......... .......... .......... 98% 354M 0s 2019-12-11T13:56:02.250 INFO:teuthology.orchestra.run.smithi073.stderr: 72350K .......... .......... .......... .......... .......... 98% 323M 0s 2019-12-11T13:56:02.250 INFO:teuthology.orchestra.run.smithi073.stderr: 72400K .......... .......... .......... .......... .......... 98% 410M 0s 2019-12-11T13:56:02.250 INFO:teuthology.orchestra.run.smithi073.stderr: 72450K .......... .......... .......... .......... .......... 98% 408M 0s 2019-12-11T13:56:02.251 INFO:teuthology.orchestra.run.smithi073.stderr: 72500K .......... .......... .......... .......... .......... 98% 354M 0s 2019-12-11T13:56:02.251 INFO:teuthology.orchestra.run.smithi073.stderr: 72550K .......... .......... .......... .......... .......... 98% 301M 0s 2019-12-11T13:56:02.251 INFO:teuthology.orchestra.run.smithi073.stderr: 72600K .......... .......... .......... .......... .......... 98% 342M 0s 2019-12-11T13:56:02.251 INFO:teuthology.orchestra.run.smithi073.stderr: 72650K .......... .......... .......... .......... .......... 98% 349M 0s 2019-12-11T13:56:02.251 INFO:teuthology.orchestra.run.smithi073.stderr: 72700K .......... .......... .......... .......... .......... 98% 382M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 72750K .......... .......... .......... .......... .......... 98% 334M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 72800K .......... .......... .......... .......... .......... 99% 384M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 72850K .......... .......... .......... .......... .......... 99% 418M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 72900K .......... .......... .......... .......... .......... 99% 394M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 72950K .......... .......... .......... .......... .......... 99% 333M 0s 2019-12-11T13:56:02.252 INFO:teuthology.orchestra.run.smithi073.stderr: 73000K .......... .......... .......... .......... .......... 99% 391M 0s 2019-12-11T13:56:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 73050K .......... .......... .......... .......... .......... 99% 426M 0s 2019-12-11T13:56:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 73100K .......... .......... .......... .......... .......... 99% 423M 0s 2019-12-11T13:56:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 73150K .......... .......... .......... .......... .......... 99% 354M 0s 2019-12-11T13:56:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 73200K .......... .......... .......... .......... .......... 99% 439M 0s 2019-12-11T13:56:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 73250K .......... .......... .......... .......... .......... 99% 442M 0s 2019-12-11T13:56:02.254 INFO:teuthology.orchestra.run.smithi073.stderr: 73300K .......... .......... .......... .......... .......... 99% 426M 0s 2019-12-11T13:56:02.254 INFO:teuthology.orchestra.run.smithi073.stderr: 73350K .......... .......... .......... .......... .......... 99% 360M 0s 2019-12-11T13:56:02.254 INFO:teuthology.orchestra.run.smithi073.stderr: 73400K .......... .......... .......... .......... .......... 99% 426M 0s 2019-12-11T13:56:02.257 INFO:teuthology.orchestra.run.smithi073.stderr: 73450K .......... .......... .......... .......... .......... 99% 428M 0s 2019-12-11T13:56:02.257 INFO:teuthology.orchestra.run.smithi073.stderr: 73500K .......... .......... .......... .......... .......... 99% 413M 0s 2019-12-11T13:56:02.257 INFO:teuthology.orchestra.run.smithi073.stderr: 73550K ........ 100% 235M=0.3s 2019-12-11T13:56:02.258 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T13:56:02.258 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11 13:56:01 (238 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-12-11T13:56:02.258 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T13:56:02.258 INFO:teuthology.orchestra.run.smithi073.stdout:Archive: gradle-4.7-bin.zip 2019-12-11T13:56:02.259 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/ 2019-12-11T13:56:02.259 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-12-11T13:56:02.259 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-12-11T13:56:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-12-11T13:56:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-12-11T13:56:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-12-11T13:56:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-12-11T13:56:02.261 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-12-11T13:56:02.261 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-12-11T13:56:02.261 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-12-11T13:56:02.262 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-12-11T13:56:02.262 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-12-11T13:56:02.262 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-12-11T13:56:02.262 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-12-11T13:56:02.262 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-12-11T13:56:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-12-11T13:56:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-12-11T13:56:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-12-11T13:56:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-12-11T13:56:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-12-11T13:56:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-12-11T13:56:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-12-11T13:56:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-12-11T13:56:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-12-11T13:56:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-12-11T13:56:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-12-11T13:56:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-12-11T13:56:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-12-11T13:56:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-12-11T13:56:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-12-11T13:56:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-12-11T13:56:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-12-11T13:56:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-12-11T13:56:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-12-11T13:56:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-12-11T13:56:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-12-11T13:56:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-12-11T13:56:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-12-11T13:56:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-12-11T13:56:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-12-11T13:56:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-12-11T13:56:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-12-11T13:56:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-12-11T13:56:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-12-11T13:56:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-12-11T13:56:02.277 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-12-11T13:56:02.277 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-12-11T13:56:02.277 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-12-11T13:56:02.277 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-12-11T13:56:02.278 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-12-11T13:56:02.278 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-12-11T13:56:02.278 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-12-11T13:56:02.278 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-12-11T13:56:02.278 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-12-11T13:56:02.279 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-12-11T13:56:02.279 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-12-11T13:56:02.279 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-12-11T13:56:02.280 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-12-11T13:56:02.280 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-12-11T13:56:02.280 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-12-11T13:56:02.280 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-12-11T13:56:02.281 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-12-11T13:56:02.281 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-12-11T13:56:02.281 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-12-11T13:56:02.281 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-12-11T13:56:02.281 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-12-11T13:56:02.282 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-12-11T13:56:02.282 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-12-11T13:56:02.283 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-12-11T13:56:02.283 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-12-11T13:56:02.284 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-12-11T13:56:02.284 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-12-11T13:56:02.284 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-12-11T13:56:02.284 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-12-11T13:56:02.284 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-12-11T13:56:02.285 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-12-11T13:56:02.285 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-12-11T13:56:02.285 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-12-11T13:56:02.285 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-12-11T13:56:02.286 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-12-11T13:56:02.286 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-12-11T13:56:02.286 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-12-11T13:56:02.286 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-12-11T13:56:02.286 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-12-11T13:56:02.287 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-12-11T13:56:02.287 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-12-11T13:56:02.287 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-12-11T13:56:02.287 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-12-11T13:56:02.288 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-12-11T13:56:02.288 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-12-11T13:56:02.288 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-12-11T13:56:02.288 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-12-11T13:56:02.289 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-12-11T13:56:02.289 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-12-11T13:56:02.289 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-12-11T13:56:02.289 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-12-11T13:56:02.289 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-12-11T13:56:02.290 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-12-11T13:56:02.290 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-12-11T13:56:02.290 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-12-11T13:56:02.290 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-12-11T13:56:02.291 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-12-11T13:56:02.291 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-12-11T13:56:02.291 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-12-11T13:56:02.291 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-12-11T13:56:02.291 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-12-11T13:56:02.292 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-12-11T13:56:02.292 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-12-11T13:56:02.292 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-12-11T13:56:02.292 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-12-11T13:56:02.296 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-12-11T13:56:02.296 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-12-11T13:56:02.297 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-12-11T13:56:02.297 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-12-11T13:56:02.297 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-12-11T13:56:02.298 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-12-11T13:56:02.298 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-12-11T13:56:02.298 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-12-11T13:56:02.298 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-12-11T13:56:02.299 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-12-11T13:56:02.299 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-12-11T13:56:02.299 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-12-11T13:56:02.299 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-12-11T13:56:02.299 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-12-11T13:56:02.300 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-12-11T13:56:02.300 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-12-11T13:56:02.300 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-12-11T13:56:02.300 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-12-11T13:56:02.301 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-12-11T13:56:02.301 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-12-11T13:56:02.301 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-12-11T13:56:02.301 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-12-11T13:56:02.301 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-12-11T13:56:02.302 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-12-11T13:56:02.302 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-12-11T13:56:02.302 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-12-11T13:56:02.302 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-12-11T13:56:02.303 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-12-11T13:56:02.303 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-12-11T13:56:02.303 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-12-11T13:56:02.303 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-12-11T13:56:02.303 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-12-11T13:56:02.304 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-12-11T13:56:02.304 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-12-11T13:56:02.304 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-12-11T13:56:02.304 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-12-11T13:56:02.305 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-12-11T13:56:02.305 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-12-11T13:56:02.306 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-12-11T13:56:02.306 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-12-11T13:56:02.306 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-12-11T13:56:02.306 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-12-11T13:56:02.307 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-12-11T13:56:02.307 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-12-11T13:56:02.307 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-12-11T13:56:02.307 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-12-11T13:56:02.307 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-12-11T13:56:02.308 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-12-11T13:56:02.308 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-12-11T13:56:02.308 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-12-11T13:56:02.308 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-12-11T13:56:02.308 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-12-11T13:56:02.309 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-12-11T13:56:02.309 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-12-11T13:56:02.309 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-12-11T13:56:02.309 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-12-11T13:56:02.310 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-12-11T13:56:02.310 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-12-11T13:56:02.310 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-12-11T13:56:02.310 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-12-11T13:56:02.310 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-12-11T13:56:02.311 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-12-11T13:56:02.311 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-12-11T13:56:02.311 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-12-11T13:56:02.311 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-12-11T13:56:02.312 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-12-11T13:56:02.313 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-12-11T13:56:02.313 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-12-11T13:56:02.313 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-12-11T13:56:02.313 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-12-11T13:56:02.313 INFO:teuthology.orchestra.run.smithi073.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-12-11T13:56:02.921 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:02.921 INFO:teuthology.orchestra.run.smithi073.stdout:Welcome to Gradle 4.7! 2019-12-11T13:56:02.921 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:02.921 INFO:teuthology.orchestra.run.smithi073.stdout:Here are the highlights of this release: 2019-12-11T13:56:02.921 INFO:teuthology.orchestra.run.smithi073.stdout: - Incremental annotation processing 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout: - JDK 10 support 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout: - Grouped non-interactive console logs 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout: - Failed tests are re-run first for quicker feedback 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-12-11T13:56:02.922 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:03.375 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:03.375 INFO:teuthology.orchestra.run.smithi073.stdout:------------------------------------------------------------ 2019-12-11T13:56:03.375 INFO:teuthology.orchestra.run.smithi073.stdout:Gradle 4.7 2019-12-11T13:56:03.375 INFO:teuthology.orchestra.run.smithi073.stdout:------------------------------------------------------------ 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Groovy: 2.4.12 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-12-11T13:56:03.376 INFO:teuthology.orchestra.run.smithi073.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-12-11T13:56:03.377 INFO:teuthology.orchestra.run.smithi073.stdout:OS: Linux 3.10.0-1062.9.1.el7.x86_64 amd64 2019-12-11T13:56:03.377 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:03.388 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-12-11T13:56:03.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-11T13:56:03.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi073.front.sepia.ceph.com 2019-12-11T13:56:03.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-11T13:56:03.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi150.front.sepia.ceph.com 2019-12-11T13:56:03.389 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-12-11T13:56:03.790 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-12-11T13:56:03.791 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-12-11T13:56:03.791 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'DEFFKNQFFZGSCLSAZKPH', 's3dir': 'folder', 'endpoint': 'smithi073.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': 'm6j2MNmLwtgCwx5RY9fHgszC4VW+VSDRF/nOtZ0IS8mw1Zy67jsNqA==', 'host': 'smithi073.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-12-11T13:56:03.791 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-12-11T13:56:03.791 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'DEFFKNQFFZGSCLSAZKPH', '--secret', 'm6j2MNmLwtgCwx5RY9fHgszC4VW+VSDRF/nOtZ0IS8mw1Zy67jsNqA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-12-11T13:56:03.792 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key DEFFKNQFFZGSCLSAZKPH --secret m6j2MNmLwtgCwx5RY9fHgszC4VW+VSDRF/nOtZ0IS8mw1Zy67jsNqA== --email tester.client.0_test@test.test --cluster ceph 2019-12-11T13:56:03.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.013+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.035+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.035+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.043+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:03.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.043+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:03.947 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.047+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:03.947 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.047+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:03.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.053+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.261+0000 7f646e456ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:56:04.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.261+0000 7f646e456ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:56:04.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.261+0000 7f646e456ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:56:04.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.261+0000 7f646e456ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:56:04.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.261+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.273+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:04.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.273+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.293+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.293+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.202 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.303+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:04.203 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.303+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.310+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:04.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.310+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.217 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.317+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:04.217 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.317+0000 7f646e456ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:56:04.217 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.317+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.222 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.322+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:04.223 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.322+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.333+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:04.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.333+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.340+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.340+0000 7f646e456ec0 20 zonegroup default 2019-12-11T13:56:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.340+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.346+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.346+0000 7f646e456ec0 10 Cannot find current period zone using local zone 2019-12-11T13:56:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.346+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.351+0000 7f646e456ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:04.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.351+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.361+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:04.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.361+0000 7f646e456ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:04.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.379+0000 7f646e456ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:04.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.379+0000 7f646e456ec0 20 zone default found 2019-12-11T13:56:04.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.379+0000 7f646e456ec0 20 started sync module instance, tier type = 2019-12-11T13:56:04.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.379+0000 7f646e456ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:56:04.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=0 2019-12-11T13:56:04.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=1 2019-12-11T13:56:04.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=2 2019-12-11T13:56:04.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=3 2019-12-11T13:56:04.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=4 2019-12-11T13:56:04.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=5 2019-12-11T13:56:04.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.818+0000 7f646e456ec0 20 add_watcher() i=6 2019-12-11T13:56:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.860+0000 7f646e456ec0 20 add_watcher() i=7 2019-12-11T13:56:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.860+0000 7f646e456ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:56:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.860+0000 7f642bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:56:04.774 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:04.874+0000 7f645b680700 0 -- >> v2:172.21.15.150:3300/0 conn(0x5587973a8a30 msgr2=0x5587973ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T13:56:04.933 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:05.033+0000 7f645b680700 0 -- 172.21.15.73:0/3588394139 >> [v2:172.21.15.73:6818/10519,v1:172.21.15.73:6819/10519] conn(0x5587973b3fc0 msgr2=0x5587973c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:56:06.359 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.458+0000 7f639a7fc700 20 reqs_thread_entry: start 2019-12-11T13:56:06.359 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.459+0000 7f6393fff700 20 reqs_thread_entry: start 2019-12-11T13:56:06.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.459+0000 7f646e456ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:56:06.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.459+0000 7f63927fc700 20 reqs_thread_entry: start 2019-12-11T13:56:06.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.459+0000 7f646e456ec0 20 get_system_obj_state: rctx=0x7ffd3a9e0b18 obj=default.rgw.meta:users.uid:tester.client.0 state=0x558797426af0 s->prefetch_data=0 2019-12-11T13:56:06.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.459+0000 7f646e456ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-12-11T13:56:06.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.468+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-12-11T13:56:06.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.468+0000 7f646e456ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-11T13:56:06.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.468+0000 7f646e456ec0 20 get_system_obj_state: rctx=0x7ffd3a9e0b28 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x558797428880 s->prefetch_data=0 2019-12-11T13:56:06.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.468+0000 7f646e456ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-12-11T13:56:06.378 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.478+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-12-11T13:56:06.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.478+0000 7f646e456ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-11T13:56:06.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.478+0000 7f646e456ec0 20 get_system_obj_state: rctx=0x7ffd3a9e0b28 obj=default.rgw.meta:users.keys:DEFFKNQFFZGSCLSAZKPH state=0x558797428880 s->prefetch_data=0 2019-12-11T13:56:06.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.478+0000 7f646e456ec0 10 cache get: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH : miss 2019-12-11T13:56:06.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.491+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH info.flags=0x0 2019-12-11T13:56:06.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.491+0000 7f646e456ec0 10 adding default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH to cache LRU end 2019-12-11T13:56:06.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.491+0000 7f646e456ec0 20 get_system_obj_state: rctx=0x7ffd3a9e0738 obj=default.rgw.meta:users.keys:DEFFKNQFFZGSCLSAZKPH state=0x558797428880 s->prefetch_data=0 2019-12-11T13:56:06.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.491+0000 7f646e456ec0 10 cache get: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH : type miss (requested=0x6, cached=0x0) 2019-12-11T13:56:06.400 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.501+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH info.flags=0x0 2019-12-11T13:56:06.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.501+0000 7f646e456ec0 10 moving default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH to cache LRU end 2019-12-11T13:56:06.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.501+0000 7f646e456ec0 20 get_system_obj_state: rctx=0x7ffd3a9e08b8 obj=default.rgw.meta:users.keys:DEFFKNQFFZGSCLSAZKPH state=0x558797428880 s->prefetch_data=0 2019-12-11T13:56:06.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.501+0000 7f646e456ec0 10 cache get: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH : type miss (requested=0x6, cached=0x0) 2019-12-11T13:56:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.514+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH info.flags=0x0 2019-12-11T13:56:06.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.514+0000 7f646e456ec0 10 moving default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH to cache LRU end 2019-12-11T13:56:06.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.577+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-11T13:56:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.577+0000 7f646e456ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-11T13:56:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.577+0000 7f646e456ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-12-11T13:56:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.591+0000 7f6440ff9700 10 RGWWatcher::handle_notify() notify_id 554050781190 cookie 94040846047392 notifier 4764 bl.length()=632 2019-12-11T13:56:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.591+0000 7f6440ff9700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-11T13:56:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.591+0000 7f6440ff9700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-11T13:56:06.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.793+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-11T13:56:06.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.793+0000 7f646e456ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-11T13:56:06.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.793+0000 7f646e456ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-12-11T13:56:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.812+0000 7f6440ff9700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94040846028176 notifier 4764 bl.length()=200 2019-12-11T13:56:06.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.812+0000 7f6440ff9700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-11T13:56:06.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:06.812+0000 7f6440ff9700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-11T13:56:07.258 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.358+0000 7f646e456ec0 10 cache put: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH info.flags=0x7 2019-12-11T13:56:07.258 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.358+0000 7f646e456ec0 10 moving default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH to cache LRU end 2019-12-11T13:56:07.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.358+0000 7f646e456ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=189 2019-12-11T13:56:07.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.377+0000 7f6440ff9700 10 RGWWatcher::handle_notify() notify_id 554050781191 cookie 94040846063744 notifier 4764 bl.length()=189 2019-12-11T13:56:07.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.378+0000 7f6440ff9700 10 cache put: name=default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH info.flags=0x7 2019-12-11T13:56:07.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.378+0000 7f6440ff9700 10 moving default.rgw.meta+users.keys+DEFFKNQFFZGSCLSAZKPH to cache LRU end 2019-12-11T13:56:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T13:56:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "tester.client.0", 2019-12-11T13:56:07.342 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Ms. tester.client.0", 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "tester.client.0_test@test.test", 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T13:56:07.343 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "tester.client.0", 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "DEFFKNQFFZGSCLSAZKPH", 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "m6j2MNmLwtgCwx5RY9fHgszC4VW+VSDRF/nOtZ0IS8mw1Zy67jsNqA==" 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2019-12-11T13:56:07.344 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T13:56:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T13:56:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T13:56:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T13:56:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T13:56:07.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:56:07.346 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T13:56:07.347 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T13:56:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T13:56:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T13:56:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T13:56:07.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.515+0000 7f646e456ec0 20 remove_watcher() i=0 2019-12-11T13:56:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.515+0000 7f646e456ec0 2 removed watcher, disabling cache 2019-12-11T13:56:07.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.576+0000 7f646e456ec0 20 remove_watcher() i=1 2019-12-11T13:56:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.629+0000 7f646e456ec0 20 remove_watcher() i=2 2019-12-11T13:56:07.607 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.706+0000 7f646e456ec0 20 remove_watcher() i=3 2019-12-11T13:56:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.769+0000 7f646e456ec0 20 remove_watcher() i=4 2019-12-11T13:56:07.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.820+0000 7f646e456ec0 20 remove_watcher() i=5 2019-12-11T13:56:07.779 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.878+0000 7f646e456ec0 20 remove_watcher() i=6 2019-12-11T13:56:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:07.937+0000 7f646e456ec0 20 remove_watcher() i=7 2019-12-11T13:56:07.852 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-12-11T13:56:07.912 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-12-11T13:56:07.914 INFO:teuthology.orchestra.run.smithi073:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-12-11T13:56:07.992 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T13:56:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.224+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.254+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.254+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.262+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.262+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.266+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.266+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.274+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.449+0000 7f35844feec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:56:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.449+0000 7f35844feec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:56:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.449+0000 7f35844feec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:56:08.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.449+0000 7f35844feec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:56:08.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.449+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.467+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:08.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.467+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.480+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:08.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.480+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.490+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.490+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.506+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.506+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.511+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.511+0000 7f35844feec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:56:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.511+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.515+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.515+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.428 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.524+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.524+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.532+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.532+0000 7f35844feec0 20 zonegroup default 2019-12-11T13:56:08.432 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.532+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.536+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.536+0000 7f35844feec0 10 Cannot find current period zone using local zone 2019-12-11T13:56:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.536+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.541+0000 7f35844feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:08.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.541+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.548+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:08.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.548+0000 7f35844feec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:08.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.560+0000 7f35844feec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.560+0000 7f35844feec0 20 zone default found 2019-12-11T13:56:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.560+0000 7f35844feec0 20 started sync module instance, tier type = 2019-12-11T13:56:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.560+0000 7f35844feec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:56:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=0 2019-12-11T13:56:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=1 2019-12-11T13:56:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=2 2019-12-11T13:56:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=3 2019-12-11T13:56:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=4 2019-12-11T13:56:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=5 2019-12-11T13:56:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.884+0000 7f35844feec0 20 add_watcher() i=6 2019-12-11T13:56:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.914+0000 7f35844feec0 20 add_watcher() i=7 2019-12-11T13:56:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.914+0000 7f35844feec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:56:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.914+0000 7f3541fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:56:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.917+0000 7f3571f29700 0 -- 172.21.15.73:0/2338146477 >> v2:172.21.15.150:3300/0 conn(0x562812c63c60 msgr2=0x562812c42430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T13:56:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:08.956+0000 7f3571728700 0 -- 172.21.15.73:0/1200733086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562812c40a40 msgr2=0x562812c2ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:56:10.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.652+0000 7f34b3fff700 20 reqs_thread_entry: start 2019-12-11T13:56:10.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.652+0000 7f35844feec0 20 init_complete bucket index max shards: 0 2019-12-11T13:56:10.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.653+0000 7f349bfff700 20 reqs_thread_entry: start 2019-12-11T13:56:10.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.653+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T13:56:10.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.652+0000 7f34b1ffb700 20 reqs_thread_entry: start 2019-12-11T13:56:10.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.747+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.784+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:10.702 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.803+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:10.763 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.864+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T13:56:10.823 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.924+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.944+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.973+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.973+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.85', time=2019-12-11T15:55:46.006812+0000, chain.objs.size()=3 2019-12-11T13:56:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.973+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.HBtsuKSZmIjPvPcArF_QK-mvibJIohj_0 2019-12-11T13:56:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.973+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.HBtsuKSZmIjPvPcArF_QK-mvibJIohj_1 2019-12-11T13:56:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:10.974+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.HBtsuKSZmIjPvPcArF_QK-mvibJIohj_2 2019-12-11T13:56:11.054 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.155+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:11.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.352+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T13:56:11.307 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.409+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:11.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.423+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:11.331 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.432+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:11.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.478+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T13:56:11.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.520+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:11.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.535+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.562+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.562+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_FkmhGsJE479SM28Rxji93_eunsbZUvb', time=2019-12-11T15:55:41.345250+0000, chain.objs.size()=3 2019-12-11T13:56:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.562+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.xdQQLwhkN_Pv7yxfc_GlXmqryW9412M_0 2019-12-11T13:56:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.562+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.xdQQLwhkN_Pv7yxfc_GlXmqryW9412M_1 2019-12-11T13:56:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.562+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.xdQQLwhkN_Pv7yxfc_GlXmqryW9412M_2 2019-12-11T13:56:11.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.783+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:11.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.878+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T13:56:11.815 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.917+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:11.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.932+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T13:56:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.114', time=2019-12-11T15:55:37.933079+0000, chain.objs.size()=2 2019-12-11T13:56:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.eFqQJ8Uh2w57zfJ6_g3cd-vBvIg-bO6_0 2019-12-11T13:56:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.eFqQJ8Uh2w57zfJ6_g3cd-vBvIg-bO6_1 2019-12-11T13:56:11.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.116', time=2019-12-11T15:55:38.748812+0000, chain.objs.size()=1 2019-12-11T13:56:11.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:11.945+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.aAjkqvD0HiA6Kh9nwUwkv0CcZEyjVpT_1 2019-12-11T13:56:11.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.041+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:12.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.165+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T13:56:12.106 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.207+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.223+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:12.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T13:56:12.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.71', time=2019-12-11T15:55:35.468563+0000, chain.objs.size()=4 2019-12-11T13:56:12.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5__multipart_foo.2~xxX6Cvdve0ei7c6ioGrRVEaXvF_ZaDO.1 2019-12-11T13:56:12.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5__multipart_foo.2~xxX6Cvdve0ei7c6ioGrRVEaXvF_ZaDO.2 2019-12-11T13:56:12.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5__multipart_foo.2~xxX6Cvdve0ei7c6ioGrRVEaXvF_ZaDO.3 2019-12-11T13:56:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.5__multipart_foo.2~xxX6Cvdve0ei7c6ioGrRVEaXvF_ZaDO.4 2019-12-11T13:56:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.234', time=2019-12-11T15:55:41.717464+0000, chain.objs.size()=5 2019-12-11T13:56:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.1 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.1_1 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.2 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.2_1 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.3 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.236', time=2019-12-11T15:55:41.978713+0000, chain.objs.size()=5 2019-12-11T13:56:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.1 2019-12-11T13:56:12.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.1_1 2019-12-11T13:56:12.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.256+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.2 2019-12-11T13:56:12.205 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.306+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.2_1 2019-12-11T13:56:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.342+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-LUKEWARM.2~1f5M0_9RJtUtvduAF83ynTsnejSUD-I.3 2019-12-11T13:56:12.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.789+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:12.827 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:12.928+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T13:56:12.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.038+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:12.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.069+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-11T13:56:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.20', time=2019-12-11T15:55:31.388675+0000, chain.objs.size()=4 2019-12-11T13:56:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2__multipart_foo.2~KSAdGJlvnwVxhFEpNpeuAF1hWMV0one.1 2019-12-11T13:56:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2__multipart_foo.2~KSAdGJlvnwVxhFEpNpeuAF1hWMV0one.2 2019-12-11T13:56:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2__multipart_foo.2~KSAdGJlvnwVxhFEpNpeuAF1hWMV0one.3 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.2__multipart_foo.2~KSAdGJlvnwVxhFEpNpeuAF1hWMV0one.4 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_jBMLDECzP2lMaEnzSF4ZX8jItQzbnRu', time=2019-12-11T15:55:37.226098+0000, chain.objs.size()=1 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.ddJ2G6vRiSY-tnohiYEnEACWpiin9dl_1 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.246', time=2019-12-11T15:55:43.061015+0000, chain.objs.size()=5 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.1 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.1_1 2019-12-11T13:56:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.2 2019-12-11T13:56:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.2_1 2019-12-11T13:56:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.3 2019-12-11T13:56:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.197', time=2019-12-11T15:55:44.486030+0000, chain.objs.size()=5 2019-12-11T13:56:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-FROZEN.2~lQFLJWX32B0tZ7yhNkdTtUJK0zozFBw.1 2019-12-11T13:56:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.142+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__shadow_foo-FROZEN.2~lQFLJWX32B0tZ7yhNkdTtUJK0zozFBw.1_1 2019-12-11T13:56:13.107 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.208+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-FROZEN.2~lQFLJWX32B0tZ7yhNkdTtUJK0zozFBw.2 2019-12-11T13:56:13.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.229+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__shadow_foo-FROZEN.2~lQFLJWX32B0tZ7yhNkdTtUJK0zozFBw.2_1 2019-12-11T13:56:13.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.229+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-FROZEN.2~lQFLJWX32B0tZ7yhNkdTtUJK0zozFBw.3 2019-12-11T13:56:13.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.451+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:13.484 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.585+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T13:56:13.527 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.628+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.646+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T13:56:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_4dYskbX_ST2d-NL9Jmy6gH23f_BFGrL', time=2019-12-11T15:55:39.053768+0000, chain.objs.size()=2 2019-12-11T13:56:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.5OmdFZpNd-bFcxp5q-W2R_T0zI0ENH9_0 2019-12-11T13:56:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.5OmdFZpNd-bFcxp5q-W2R_T0zI0ENH9_1 2019-12-11T13:56:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_20bvbbZL31ceEIiinOLTT0eR2tT2sPk', time=2019-12-11T15:55:42.590589+0000, chain.objs.size()=3 2019-12-11T13:56:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.WoWc3L1iax5Nj09xFrAqdI-ZopcTlIt_0 2019-12-11T13:56:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.WoWc3L1iax5Nj09xFrAqdI-ZopcTlIt_1 2019-12-11T13:56:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.662+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.WoWc3L1iax5Nj09xFrAqdI-ZopcTlIt_2 2019-12-11T13:56:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.875+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:13.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:13.979+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T13:56:13.936 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.037+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.063+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:13.984 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.077+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:14.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.137+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T13:56:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.184+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:14.104 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.205+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.218+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.218+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.112', time=2019-12-11T15:55:37.502018+0000, chain.objs.size()=2 2019-12-11T13:56:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.218+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.eFqQJ8Uh2w57zfJ6_g3cd-vBvIg-bO6_0 2019-12-11T13:56:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.218+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.eFqQJ8Uh2w57zfJ6_g3cd-vBvIg-bO6_1 2019-12-11T13:56:14.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.413+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:14.556 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.657+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T13:56:14.613 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.715+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:14.630 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.731+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:14.640 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.742+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.774+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T13:56:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.840+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.868+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T13:56:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_z8FHvC-1gHhKbZP_0afYRe6mjqXWHNl', time=2019-12-11T15:55:37.027440+0000, chain.objs.size()=2 2019-12-11T13:56:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.6gOACRzY-YwdvkjaDzPcRR2jxbCP1uV_0 2019-12-11T13:56:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.6gOACRzY-YwdvkjaDzPcRR2jxbCP1uV_1 2019-12-11T13:56:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_YVsoYWBZ5cAl6ocyhhcNZxrU9FGWMRQ', time=2019-12-11T15:55:37.749601+0000, chain.objs.size()=2 2019-12-11T13:56:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.xVC7I-hMoGhhxhZvVoZ7Ljli2iHjfds_0 2019-12-11T13:56:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.xVC7I-hMoGhhxhZvVoZ7Ljli2iHjfds_1 2019-12-11T13:56:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_JPN63QpTBXql8diPG-9oE8JCenUr_vI', time=2019-12-11T15:55:41.598169+0000, chain.objs.size()=2 2019-12-11T13:56:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.DHL5CvRAgt4COgMWeV1ulRWofnLcC-z_1 2019-12-11T13:56:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:14.886+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.DHL5CvRAgt4COgMWeV1ulRWofnLcC-z_2 2019-12-11T13:56:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.158+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:15.177 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.279+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T13:56:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.324+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:15.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.343+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:15.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.358+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:15.305 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.406+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T13:56:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.461+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.476+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.40', time=2019-12-11T15:55:32.640771+0000, chain.objs.size()=7 2019-12-11T13:56:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__multipart_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.1 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__shadow_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.1_1 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__multipart_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.2 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__shadow_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.2_1 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__multipart_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.3 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__shadow_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.3_1 2019-12-11T13:56:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.492+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.3__multipart_foo.2~o_p9PEVuwkVZIzF-jVMXTZJghWTLk63.4 2019-12-11T13:56:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.798+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.931+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T13:56:15.877 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.978+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:15.892 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:15.994+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:15.907 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.008+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:15.907 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.008+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.109', time=2019-12-11T15:55:36.823894+0000, chain.objs.size()=2 2019-12-11T13:56:15.907 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.008+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.i922yMUo10TWx0HyHHEOwEZtl1L3MtS_0 2019-12-11T13:56:15.907 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.008+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.i922yMUo10TWx0HyHHEOwEZtl1L3MtS_1 2019-12-11T13:56:16.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.145+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.227+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T13:56:16.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.267+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:16.184 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.286+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:16.194 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.119', time=2019-12-11T15:55:39.447929+0000, chain.objs.size()=1 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.aAjkqvD0HiA6Kh9nwUwkv0CcZEyjVpT_1 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_bGsLqT50HWpP7Dm9yLxXw5grF2MlOO5', time=2019-12-11T15:55:41.860706+0000, chain.objs.size()=3 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.IG-XwR_MqpbBzf1Eycq_kUu4E222827_0 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.IG-XwR_MqpbBzf1Eycq_kUu4E222827_1 2019-12-11T13:56:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.296+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.IG-XwR_MqpbBzf1Eycq_kUu4E222827_2 2019-12-11T13:56:16.406 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.508+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:16.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.587+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T13:56:16.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.635+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.650+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.658+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:16.595 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.697+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T13:56:16.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.764+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:16.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.789+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:16.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.807+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:16.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.807+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.84', time=2019-12-11T15:55:45.778073+0000, chain.objs.size()=3 2019-12-11T13:56:16.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.807+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.RyiFFtoAmke6z3z8gl9Ph553xZOpMGx_0 2019-12-11T13:56:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.808+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.RyiFFtoAmke6z3z8gl9Ph553xZOpMGx_1 2019-12-11T13:56:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:16.808+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.6__shadow_.RyiFFtoAmke6z3z8gl9Ph553xZOpMGx_2 2019-12-11T13:56:16.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.014+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.131+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T13:56:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.176+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.094 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.196+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.205+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.146 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.247+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T13:56:17.231 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.333+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.362+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:17.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T13:56:17.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_Socpn7x0LK7yU8aMQCv1Muz9N_x1f6H', time=2019-12-11T15:55:38.306098+0000, chain.objs.size()=1 2019-12-11T13:56:17.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.yI1ymtmOJOI_F6zUOjKZXZrueVY75Tp_1 2019-12-11T13:56:17.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.211', time=2019-12-11T15:55:44.851308+0000, chain.objs.size()=3 2019-12-11T13:56:17.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-STANDARD.2~PXHzT0Vyet5AXUDpGkouPBJnOmYvd5N.1 2019-12-11T13:56:17.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-STANDARD.2~PXHzT0Vyet5AXUDpGkouPBJnOmYvd5N.2 2019-12-11T13:56:17.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.381+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-STANDARD.2~PXHzT0Vyet5AXUDpGkouPBJnOmYvd5N.3 2019-12-11T13:56:17.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.449+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.539+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T13:56:17.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.582+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.597+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.225', time=2019-12-11T15:55:40.988514+0000, chain.objs.size()=5 2019-12-11T13:56:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.1 2019-12-11T13:56:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.1_1 2019-12-11T13:56:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.2 2019-12-11T13:56:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.2_1 2019-12-11T13:56:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.609+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.3 2019-12-11T13:56:17.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.730+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:17.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.824+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T13:56:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.870+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.887+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:17.800 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.901+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:17.935+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T13:56:17.911 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.012+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:17.938 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.039+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:17.985 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.086+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:17.985 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.086+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_xXzpp6Ir-ZX_CZF1Y6E-Fm2aNYrxI0I', time=2019-12-11T15:55:42.147183+0000, chain.objs.size()=2 2019-12-11T13:56:17.986 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.086+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.vGqxvYrzSCLceuuLlIHDqU1vBKr9utC_1 2019-12-11T13:56:17.986 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.086+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.vGqxvYrzSCLceuuLlIHDqU1vBKr9utC_2 2019-12-11T13:56:18.105 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.206+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:18.207 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.308+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T13:56:18.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.363+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.381+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:18.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.390+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.321 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.422+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T13:56:18.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.461+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.476+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.484+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.428 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.529+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T13:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.589+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.617+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.55', time=2019-12-11T15:55:34.018442+0000, chain.objs.size()=4 2019-12-11T13:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4__multipart_foo.2~WTPgLwBmlilnYFMCG9ZHym1IAmJgr_o.1 2019-12-11T13:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4__multipart_foo.2~WTPgLwBmlilnYFMCG9ZHym1IAmJgr_o.2 2019-12-11T13:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4__multipart_foo.2~WTPgLwBmlilnYFMCG9ZHym1IAmJgr_o.3 2019-12-11T13:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.641+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.4__multipart_foo.2~WTPgLwBmlilnYFMCG9ZHym1IAmJgr_o.4 2019-12-11T13:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.714+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:18.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.823+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T13:56:18.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.871+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.790 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.891+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.902+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:18.945+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T13:56:18.910 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.011+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.029+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.243', time=2019-12-11T15:55:42.440532+0000, chain.objs.size()=5 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.1 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.1_1 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.2 2019-12-11T13:56:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.2_1 2019-12-11T13:56:18.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.040+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-STANDARD.2~3XSexKO9_ehos4iUH_Lk1DL3DyR0zvA.3 2019-12-11T13:56:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.207+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.334+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T13:56:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.407+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.435+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.452+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.452+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_DGSRFgxc-AewVM7vWEKIddv-XBJLzAY', time=2019-12-11T15:55:42.876869+0000, chain.objs.size()=3 2019-12-11T13:56:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.452+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.0tk0cZvqIIyyax2xlqo2RRLHj_ENVfH_0 2019-12-11T13:56:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.452+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.0tk0cZvqIIyyax2xlqo2RRLHj_ENVfH_1 2019-12-11T13:56:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.452+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_.0tk0cZvqIIyyax2xlqo2RRLHj_ENVfH_2 2019-12-11T13:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.650+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.761+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T13:56:19.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.827+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:19.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.842+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:19.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.853+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:19.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.853+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.204', time=2019-12-11T15:55:44.751638+0000, chain.objs.size()=5 2019-12-11T13:56:19.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.853+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-LUKEWARM.2~Rfxut0qhSS9dI6X4xJ8FA5-a94i8XiY.1 2019-12-11T13:56:19.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.853+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__shadow_foo-LUKEWARM.2~Rfxut0qhSS9dI6X4xJ8FA5-a94i8XiY.1_1 2019-12-11T13:56:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.854+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-LUKEWARM.2~Rfxut0qhSS9dI6X4xJ8FA5-a94i8XiY.2 2019-12-11T13:56:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.854+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__shadow_foo-LUKEWARM.2~Rfxut0qhSS9dI6X4xJ8FA5-a94i8XiY.2_1 2019-12-11T13:56:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:19.854+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.8__multipart_foo-LUKEWARM.2~Rfxut0qhSS9dI6X4xJ8FA5-a94i8XiY.3 2019-12-11T13:56:19.935 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.037+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:20.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.159+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T13:56:20.131 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.233+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.263+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.274+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T13:56:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.274+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.108', time=2019-12-11T15:55:36.582195+0000, chain.objs.size()=2 2019-12-11T13:56:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.274+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.i922yMUo10TWx0HyHHEOwEZtl1L3MtS_0 2019-12-11T13:56:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.274+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.i922yMUo10TWx0HyHHEOwEZtl1L3MtS_1 2019-12-11T13:56:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.430+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:20.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.532+0000 7f35844feec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T13:56:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.603+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:20.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.627+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:20.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='_10eI677Bd_YJOx7LeSjQbjmc1BDP2pr', time=2019-12-11T15:55:38.961331+0000, chain.objs.size()=2 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.cMg-b1ZpLUQb_JjeM4pmM9-K4RJqnA1_0 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.7__shadow_.cMg-b1ZpLUQb_JjeM4pmM9-K4RJqnA1_1 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.226', time=2019-12-11T15:55:41.172541+0000, chain.objs.size()=5 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.1 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.1_1 2019-12-11T13:56:20.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.2 2019-12-11T13:56:20.543 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__shadow_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.2_1 2019-12-11T13:56:20.543 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.643+0000 7f35844feec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.9__multipart_foo-FROZEN.2~7DwGGMihFNlKdI3f3EoGwjRPPjHPd1K.3 2019-12-11T13:56:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:20.899+0000 7f35844feec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T13:56:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.096+0000 7f35844feec0 20 remove_watcher() i=0 2019-12-11T13:56:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.096+0000 7f35844feec0 2 removed watcher, disabling cache 2019-12-11T13:56:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.128+0000 7f35844feec0 20 remove_watcher() i=1 2019-12-11T13:56:21.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.158+0000 7f35844feec0 20 remove_watcher() i=2 2019-12-11T13:56:21.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.226+0000 7f35844feec0 20 remove_watcher() i=3 2019-12-11T13:56:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.267+0000 7f35844feec0 20 remove_watcher() i=4 2019-12-11T13:56:21.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.331+0000 7f35844feec0 20 remove_watcher() i=5 2019-12-11T13:56:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.381+0000 7f35844feec0 20 remove_watcher() i=6 2019-12-11T13:56:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.456+0000 7f35844feec0 20 remove_watcher() i=7 2019-12-11T13:56:21.364 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T13:56:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.625+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.648+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.648+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.656+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.656+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.660+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.660+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.566 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.669+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.827+0000 7f171f756ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T13:56:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.827+0000 7f171f756ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T13:56:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.827+0000 7f171f756ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T13:56:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.827+0000 7f171f756ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T13:56:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.827+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.732 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.835+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:21.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.835+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.849+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:21.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.850+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.860+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:21.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.860+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.782 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.884+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:21.782 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.884+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.890+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.890+0000 7f171f756ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T13:56:21.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.890+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.896+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.896+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.802 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.904+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:21.802 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.904+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.911+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T13:56:21.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.911+0000 7f171f756ec0 20 zonegroup default 2019-12-11T13:56:21.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.911+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.916+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.916+0000 7f171f756ec0 10 Cannot find current period zone using local zone 2019-12-11T13:56:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.916+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.920+0000 7f171f756ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T13:56:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.920+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.825 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.928+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T13:56:21.826 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.928+0000 7f171f756ec0 20 rados->read ofs=0 len=0 2019-12-11T13:56:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.947+0000 7f171f756ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T13:56:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.947+0000 7f171f756ec0 20 zone default found 2019-12-11T13:56:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.947+0000 7f171f756ec0 20 started sync module instance, tier type = 2019-12-11T13:56:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:21.947+0000 7f171f756ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T13:56:22.297 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f170c980700 0 -- 172.21.15.73:0/1873916219 >> [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] conn(0x559bb07a0c60 msgr2=0x559bb07a30a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:56:22.297 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=0 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=1 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=2 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=3 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=4 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=5 2019-12-11T13:56:22.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.399+0000 7f171f756ec0 20 add_watcher() i=6 2019-12-11T13:56:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.460+0000 7f171f756ec0 20 add_watcher() i=7 2019-12-11T13:56:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.460+0000 7f171f756ec0 2 all 8 watchers are set, enabling cache 2019-12-11T13:56:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.461+0000 7f16dcfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T13:56:22.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:22.479+0000 7f1707fff700 0 -- 172.21.15.73:0/2408044696 >> v2:172.21.15.150:3300/0 conn(0x559bb07d4e60 msgr2=0x559bb07ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T13:56:23.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.900+0000 7f164effd700 20 reqs_thread_entry: start 2019-12-11T13:56:23.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.900+0000 7f164cff9700 20 reqs_thread_entry: start 2019-12-11T13:56:23.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.900+0000 7f171f756ec0 20 init_complete bucket index max shards: 0 2019-12-11T13:56:23.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.901+0000 7f1642ffd700 20 reqs_thread_entry: start 2019-12-11T13:56:23.799 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.901+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T13:56:23.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.940+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:23.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.957+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:23.863 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:23.966+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:23.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.017+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T13:56:23.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.060+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:23.976 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.078+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:23.985 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.087+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.127+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T13:56:24.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.168+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.183+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.194+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.125 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.227+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T13:56:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.277+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.295+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.308+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.343+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T13:56:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.432+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.480+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.494+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.549+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T13:56:24.500 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.602+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.620+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.627+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.662+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T13:56:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.721+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.750+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.761+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.815+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T13:56:24.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.871+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.886+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.896+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.930+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T13:56:24.876 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.978+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.891 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:24.993+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:24.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.002+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.033+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T13:56:24.977 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.080+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:24.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.097+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.004 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.107+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.150+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T13:56:25.109 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.212+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.233+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.248+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.285 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.387+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T13:56:25.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.441+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.356 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.459+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.365 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.468+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.506+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T13:56:25.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.546+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.565+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.577+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.605+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T13:56:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.646+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.660+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.566 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.668+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.700+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T13:56:25.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.776+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.791+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.799+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.842+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T13:56:25.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.916+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.841 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.943+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:25.961+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.907 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.009+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T13:56:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.067+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:25.984 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.086+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:25.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.100+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.032 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.134+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T13:56:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.219+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.251+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.270+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.336+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T13:56:26.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.403+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.425+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.438+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.370 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.473+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T13:56:26.422 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.525+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.543+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.555+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.586+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T13:56:26.581 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.684+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.606 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.709+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.724+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.765+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T13:56:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.825+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.852+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.864+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.796 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.899+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T13:56:26.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.952+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.972+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:26.981+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.015+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T13:56:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.072+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.092+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.101+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.147+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T13:56:27.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.203+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.219+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.227+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.257+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T13:56:27.214 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.317+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.339+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.248 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.351+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.401+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T13:56:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.470+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.494+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.506+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.543+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T13:56:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.601+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.617+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.628+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.575 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.677+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T13:56:27.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.751+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.775+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.788+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.744 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.847+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T13:56:27.826 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.929+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.944+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:27.851 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.954+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:27.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:27.986+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T13:56:27.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.076+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.106+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:28.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.124+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:28.080 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.183+0000 7f171f756ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T13:56:28.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.268+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:28.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.291+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T13:56:28.202 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.304+0000 7f171f756ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T13:56:28.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.403+0000 7f171f756ec0 20 remove_watcher() i=0 2019-12-11T13:56:28.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.403+0000 7f171f756ec0 2 removed watcher, disabling cache 2019-12-11T13:56:28.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.441+0000 7f171f756ec0 20 remove_watcher() i=1 2019-12-11T13:56:28.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.477+0000 7f171f756ec0 20 remove_watcher() i=2 2019-12-11T13:56:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.552+0000 7f171f756ec0 20 remove_watcher() i=3 2019-12-11T13:56:28.493 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.594+0000 7f171f756ec0 20 remove_watcher() i=4 2019-12-11T13:56:28.543 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.645+0000 7f171f756ec0 20 remove_watcher() i=5 2019-12-11T13:56:28.598 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.700+0000 7f171f756ec0 20 remove_watcher() i=6 2019-12-11T13:56:28.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T13:56:28.750+0000 7f171f756ec0 20 remove_watcher() i=7 2019-12-11T13:56:28.657 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-12-11T13:56:29.309 INFO:teuthology.orchestra.run.smithi073.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-12-11T13:56:32.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-12-11T13:56:32.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-12-11T13:56:34.109 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean UP-TO-DATE 2019-12-11T13:56:34.208 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-12-11T13:56:34.208 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-12-11T13:56:34.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-12-11T13:56:34.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-12-11T13:56:34.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-12-11T13:56:34.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-12-11T13:56:34.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-12-11T13:56:34.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-12-11T13:56:34.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-12-11T13:56:34.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-12-11T13:56:34.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-12-11T13:56:34.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-12-11T13:56:34.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-12-11T13:56:34.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-12-11T13:56:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-12-11T13:56:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-12-11T13:56:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-12-11T13:56:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-12-11T13:56:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-12-11T13:56:34.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-12-11T13:56:34.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-12-11T13:56:34.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-12-11T13:56:34.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-12-11T13:56:34.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-12-11T13:56:34.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-12-11T13:56:34.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-12-11T13:56:34.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-12-11T13:56:34.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-12-11T13:56:34.713 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-12-11T13:56:34.714 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-12-11T13:56:34.714 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-12-11T13:56:34.714 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-12-11T13:56:34.714 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-12-11T13:56:34.714 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-12-11T13:56:34.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-12-11T13:56:34.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-12-11T13:56:34.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-12-11T13:56:34.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-12-11T13:56:34.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-12-11T13:56:34.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-12-11T13:56:34.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-12-11T13:56:34.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-12-11T13:56:34.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-12-11T13:56:34.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-12-11T13:56:34.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-12-11T13:56:34.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-12-11T13:56:34.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-12-11T13:56:34.815 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-12-11T13:56:34.815 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-12-11T13:56:34.815 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-12-11T13:56:34.815 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-12-11T13:56:34.815 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-12-11T13:56:34.816 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-12-11T13:56:34.817 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-12-11T13:56:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-12-11T13:56:34.819 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-12-11T13:56:34.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-12-11T13:56:34.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-12-11T13:56:34.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-12-11T13:56:34.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-12-11T13:56:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-12-11T13:56:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-12-11T13:56:34.912 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-12-11T13:56:34.912 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-12-11T13:56:34.912 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-12-11T13:56:34.912 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-12-11T13:56:34.912 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-12-11T13:56:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-12-11T13:56:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-12-11T13:56:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-12-11T13:56:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-12-11T13:56:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-12-11T13:56:34.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-12-11T13:56:34.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-12-11T13:56:34.916 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-12-11T13:56:35.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-12-11T13:56:35.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-12-11T13:56:35.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-12-11T13:56:35.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-12-11T13:56:35.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-12-11T13:56:35.013 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-12-11T13:56:35.014 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-12-11T13:56:35.015 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-12-11T13:56:35.015 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-12-11T13:56:35.015 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-12-11T13:56:35.015 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-12-11T13:56:35.107 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-12-11T13:56:35.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-12-11T13:56:35.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-12-11T13:56:35.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-12-11T13:56:35.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-12-11T13:56:35.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-12-11T13:56:35.208 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-12-11T13:56:35.208 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-12-11T13:56:35.208 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-12-11T13:56:35.209 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-12-11T13:56:35.209 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-12-11T13:56:35.209 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-12-11T13:56:35.210 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-12-11T13:56:35.210 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-12-11T13:56:35.210 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-12-11T13:56:35.307 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-12-11T13:56:35.307 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-12-11T13:56:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-12-11T13:56:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-12-11T13:56:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-12-11T13:56:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-12-11T13:56:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-12-11T13:56:35.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-12-11T13:56:35.409 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-12-11T13:56:35.410 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-12-11T13:56:35.410 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-12-11T13:56:35.410 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-12-11T13:56:35.410 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-12-11T13:56:35.410 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-12-11T13:56:35.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-12-11T13:56:35.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-12-11T13:56:35.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-12-11T13:56:35.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-12-11T13:56:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-12-11T13:56:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-12-11T13:56:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-12-11T13:56:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-12-11T13:56:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-12-11T13:56:35.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-12-11T13:56:35.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-12-11T13:56:35.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-12-11T13:56:35.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-12-11T13:56:35.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-12-11T13:56:35.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-12-11T13:56:35.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-12-11T13:56:35.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-12-11T13:56:35.712 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-12-11T13:56:35.807 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-12-11T13:56:35.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-12-11T13:56:35.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-12-11T13:56:35.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-12-11T13:56:36.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-12-11T13:56:36.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-12-11T13:56:36.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-12-11T13:56:36.608 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-12-11T13:56:36.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-12-11T13:56:36.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-12-11T13:56:36.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-12-11T13:56:36.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-12-11T13:56:36.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-12-11T13:56:36.710 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-12-11T13:56:36.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-12-11T13:56:36.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-12-11T13:56:36.711 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-12-11T13:56:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-12-11T13:56:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-12-11T13:56:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-12-11T13:56:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-12-11T13:56:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-12-11T13:56:36.809 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-12-11T13:56:36.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-12-11T13:56:36.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-12-11T13:56:36.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-12-11T13:56:36.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-12-11T13:56:36.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-12-11T13:56:36.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-12-11T13:56:36.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-12-11T13:56:36.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-12-11T13:56:36.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-12-11T13:56:36.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-12-11T13:56:36.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-12-11T13:56:36.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-12-11T13:56:36.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-12-11T13:56:36.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-12-11T13:56:36.909 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-12-11T13:56:36.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-12-11T13:56:36.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-12-11T13:56:36.910 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-12-11T13:56:37.007 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-12-11T13:56:37.008 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-12-11T13:56:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-12-11T13:56:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-12-11T13:56:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-12-11T13:56:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-12-11T13:56:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-12-11T13:56:37.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-12-11T13:56:37.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-12-11T13:56:37.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-12-11T13:56:37.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-12-11T13:56:37.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-12-11T13:56:37.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-12-11T13:56:37.110 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-12-11T13:56:37.212 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-12-11T13:56:37.213 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-12-11T13:56:37.213 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-12-11T13:56:37.213 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-12-11T13:56:37.214 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-12-11T13:56:37.214 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-12-11T13:56:37.214 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-12-11T13:56:37.214 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-12-11T13:56:37.215 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-12-11T13:56:37.215 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-12-11T13:56:37.215 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-12-11T13:56:37.215 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-12-11T13:56:37.216 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-12-11T13:56:37.216 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-12-11T13:56:37.217 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-12-11T13:56:37.217 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-12-11T13:56:37.217 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-12-11T13:56:37.307 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-12-11T13:56:37.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-12-11T13:56:37.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-12-11T13:56:37.308 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-12-11T13:56:37.407 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-12-11T13:56:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-12-11T13:56:37.507 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-12-11T13:56:37.508 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-12-11T13:56:37.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-12-11T13:56:37.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-12-11T13:56:37.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-12-11T13:56:37.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-12-11T13:56:37.509 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-12-11T13:56:37.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-12-11T13:56:37.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-12-11T13:56:37.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-12-11T13:56:37.510 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-12-11T13:56:37.511 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-12-11T13:56:37.511 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-12-11T13:56:37.511 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-12-11T13:56:37.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-12-11T13:56:37.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-12-11T13:56:37.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-12-11T13:56:37.609 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-12-11T13:56:37.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-12-11T13:56:37.610 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-12-11T13:56:37.707 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-12-11T13:56:37.708 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-12-11T13:56:37.709 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-12-11T13:56:37.807 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-12-11T13:56:37.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-12-11T13:56:37.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-12-11T13:56:37.808 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-12-11T13:56:37.810 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-12-11T13:56:37.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-12-11T13:56:37.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-12-11T13:56:37.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-12-11T13:56:37.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-12-11T13:56:37.811 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-12-11T13:56:37.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-12-11T13:56:37.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-12-11T13:56:37.812 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-12-11T13:56:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-12-11T13:56:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-12-11T13:56:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-12-11T13:56:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-12-11T13:56:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-12-11T13:56:37.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-12-11T13:56:37.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-12-11T13:56:37.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-12-11T13:56:37.814 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-12-11T13:56:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-12-11T13:56:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-12-11T13:56:37.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-12-11T13:56:37.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-12-11T13:56:37.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-12-11T13:56:37.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-12-11T13:56:37.914 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-12-11T13:56:37.915 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-12-11T13:56:37.916 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-12-11T13:56:38.009 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-12-11T13:56:38.010 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-12-11T13:56:38.011 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-12-11T13:56:38.012 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-12-11T13:56:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-12-11T13:56:38.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-12-11T13:56:38.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-12-11T13:56:38.109 INFO:teuthology.orchestra.run.smithi073.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-12-11T13:56:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2019-12-11T13:56:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2019-12-11T13:56:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2019-12-11T13:56:47.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:47.307 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2019-12-11T13:56:47.307 INFO:teuthology.orchestra.run.smithi073.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-11T13:56:47.307 INFO:teuthology.orchestra.run.smithi073.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-11T13:56:47.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:47.308 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2019-12-11T13:56:47.308 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2019-12-11T13:56:55.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:55.305 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2019-12-11T13:56:55.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:56:55.305 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-12-11T13:57:51.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:57:51.703 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-12-11T13:57:57.103 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:57:57.103 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-12-11T13:57:59.903 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:57:59.903 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-12-11T13:58:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:05.603 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-12-11T13:58:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:25.103 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-12-11T13:58:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:30.903 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-12-11T13:58:31.303 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:31.303 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-12-11T13:58:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:32.003 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-12-11T13:58:34.203 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:34.203 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-12-11T13:58:40.003 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:58:40.003 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-12-11T13:58:45.670 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:16:45.898 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.698 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:16:45.926 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.714 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:16:45.911 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.718 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:16:45.915 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.721 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:45.949 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.726 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:45.954 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:45.897 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:16:46.095 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:46.009 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:46.237 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:58:46.027 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:16:46.255 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:06.608 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:59:06.608 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-12-11T13:59:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T13:59:19.403 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-12-11T13:59:32.834 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:17:33.062 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.887 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:17:33.116 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.892 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:33.120 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.894 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:33.122 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.918 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:17:33.115 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.920 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:17:33.117 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.929 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:33.158 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.933 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:17:33.162 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T13:59:32.979 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:17:33.176 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:02:43.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:02:43.502 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-12-11T14:02:57.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:02:57.001 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-12-11T14:02:58.901 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:02:58.901 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-12-11T14:03:04.401 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:04.401 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-12-11T14:03:07.701 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:07.701 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-12-11T14:03:19.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:19.002 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-12-11T14:03:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:38.201 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-12-11T14:03:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:44.601 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-12-11T14:03:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:45.200 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-12-11T14:03:45.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:03:45.601 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-12-11T14:03:53.573 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:21:53.804 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.591 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:21:53.821 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.617 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:21:53.848 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.618 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:21:53.849 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.641 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:21:53.838 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.643 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:21:53.841 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.779 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:21:54.009 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.808 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:21:54.038 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:03:53.815 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:21:54.011 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:04:10.000 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:04:10.000 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-12-11T14:04:16.100 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:04:16.100 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-12-11T14:04:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:04:49.600 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-12-11T14:05:01.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:05:01.600 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-12-11T14:05:30.599 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:05:30.600 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-12-11T14:05:36.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:05:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-12-11T14:07:54.171 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:25:54.403 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.206 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:25:54.439 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.297 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:25:54.481 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.314 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:25:54.547 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.317 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:25:54.501 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.319 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:54.552 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.336 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:54.568 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.439 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:54.672 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:07:54.473 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:25:54.658 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:12:59.296 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:12:59.296 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-12-11T14:13:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:13:08.196 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-12-11T14:13:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:13:51.597 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-12-11T14:13:57.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:13:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-12-11T14:14:20.321 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:32:20.555 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.329 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:32:20.563 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.335 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:20.569 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.345 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:20.574 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.347 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:32:20.520 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.357 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:32:20.529 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.561 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:32:20.795 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.571 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:32:20.805 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:20.651 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:32:20.822 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:14:50.797 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:14:50.797 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-12-11T14:14:57.197 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:14:57.197 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-12-11T14:15:06.797 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:06.797 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-12-11T14:15:18.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:18.497 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-12-11T14:15:20.597 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:20.597 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-12-11T14:15:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:25.297 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-12-11T14:15:26.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:26.698 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-12-11T14:15:32.197 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:32.198 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-12-11T14:15:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:35.497 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-12-11T14:15:42.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:42.397 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-12-11T14:15:45.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:45.498 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-12-11T14:15:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:52.498 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-12-11T14:15:56.597 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:15:56.598 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-12-11T14:16:02.298 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:02.298 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-12-11T14:16:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:05.898 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-12-11T14:16:12.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:12.999 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-12-11T14:16:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:15.199 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-12-11T14:16:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:21.599 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-12-11T14:16:49.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:49.301 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-12-11T14:16:56.903 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:56.903 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2019-12-11T14:16:56.904 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-12-11T14:16:56.904 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2019-12-11T14:16:57.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:16:57.001 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 20m 28s 2019-12-11T14:16:57.001 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-12-11T14:16:57.437 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:16:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.616+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.640+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.640+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.641 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.648+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.641 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.648+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.654+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.654+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.654 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.662+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:16:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.832+0000 7f6209056ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:16:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.832+0000 7f6209056ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:16:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.832+0000 7f6209056ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:16:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.832+0000 7f6209056ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:16:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.832+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.838+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:16:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.838+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.858+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:16:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.858+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.868+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:16:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.868+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.879+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:16:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.879+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.886+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.886+0000 7f6209056ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:16:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.886+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.885 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.893+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.893+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.906+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:16:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.906+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.914+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:16:57.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.914+0000 7f6209056ec0 20 zonegroup default 2019-12-11T14:16:57.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.914+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.918+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.918+0000 7f6209056ec0 10 Cannot find current period zone using local zone 2019-12-11T14:16:57.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.918+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.917 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.925+0000 7f6209056ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:16:57.917 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.925+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.927 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.934+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:16:57.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.934+0000 7f6209056ec0 20 rados->read ofs=0 len=0 2019-12-11T14:16:57.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.971+0000 7f6209056ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:16:57.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.971+0000 7f6209056ec0 20 zone default found 2019-12-11T14:16:57.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.971+0000 7f6209056ec0 20 started sync module instance, tier type = 2019-12-11T14:16:57.963 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:57.971+0000 7f6209056ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=0 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=1 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=2 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=3 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=4 2019-12-11T14:16:58.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.394+0000 7f6209056ec0 20 add_watcher() i=5 2019-12-11T14:16:58.429 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.437+0000 7f6209056ec0 20 add_watcher() i=6 2019-12-11T14:16:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.453+0000 7f6209056ec0 20 add_watcher() i=7 2019-12-11T14:16:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.453+0000 7f6209056ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:16:58.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.453+0000 7f61c6fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:16:58.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.456+0000 7f61f6a81700 0 -- 172.21.15.73:0/1594461295 >> v2:172.21.15.150:3300/0 conn(0x564560ea0ff0 msgr2=0x564560ea78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:16:58.472 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:58.480+0000 7f61f6280700 0 -- 172.21.15.73:0/2629220890 >> v2:172.21.15.73:3300/0 conn(0x564560ec63c0 msgr2=0x564560eade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T14:16:59.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:59.928+0000 7f61357fa700 20 reqs_thread_entry: start 2019-12-11T14:16:59.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:59.928+0000 7f612effd700 20 reqs_thread_entry: start 2019-12-11T14:16:59.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:59.928+0000 7f6209056ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:16:59.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:59.929+0000 7f612d7fa700 20 reqs_thread_entry: start 2019-12-11T14:16:59.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:16:59.929+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:17:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.021+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.054 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.062+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:00.072 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.079+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.145+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:17:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.350+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.386+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:00.395 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.403+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.465+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:17:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.524+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.546+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.557+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.622+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:17:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.692+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.713+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.725+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.773+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:17:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.817+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.834+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.858+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T14:17:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.858+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.447', time=2019-12-11T16:01:30.205289+0000, chain.objs.size()=9 2019-12-11T14:17:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.1 2019-12-11T14:17:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.1_1 2019-12-11T14:17:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.2 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.2_1 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.3 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.3_1 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.4 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.4_1 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~w8Co4tXRVkY3T5aO4VHyOb464yue3PG.5 2019-12-11T14:17:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.557', time=2019-12-11T16:04:54.321370+0000, chain.objs.size()=9 2019-12-11T14:17:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.1 2019-12-11T14:17:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.1_1 2019-12-11T14:17:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:00.859+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.2 2019-12-11T14:17:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.223+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.2_1 2019-12-11T14:17:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.3 2019-12-11T14:17:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.3_1 2019-12-11T14:17:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.4 2019-12-11T14:17:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.4_1 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file2.mpg.2~HCkSSUqh15W7Nz7x3LEOIFIMl6xBr0h.5 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.606', time=2019-12-11T16:09:40.274136+0000, chain.objs.size()=21 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.1 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.1_1 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.2 2019-12-11T14:17:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.2_1 2019-12-11T14:17:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.310+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.3 2019-12-11T14:17:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.509+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.3_1 2019-12-11T14:17:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.509+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.4 2019-12-11T14:17:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.509+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.4_1 2019-12-11T14:17:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.5 2019-12-11T14:17:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.5_1 2019-12-11T14:17:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.6 2019-12-11T14:17:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.6_1 2019-12-11T14:17:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.7 2019-12-11T14:17:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.7_1 2019-12-11T14:17:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.8 2019-12-11T14:17:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.656+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.8_1 2019-12-11T14:17:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.671+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.9 2019-12-11T14:17:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.783+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.9_1 2019-12-11T14:17:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.783+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.10 2019-12-11T14:17:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.783+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.10_1 2019-12-11T14:17:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:01.907+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~w98_GRyuZE5quL3-2zkKh0pRYtLkohB.11 2019-12-11T14:17:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.054+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:02.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.145+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:17:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.202+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:02.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.226+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.618', time=2019-12-11T16:10:41.631625+0000, chain.objs.size()=19 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.1 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.1_1 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.2 2019-12-11T14:17:02.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.2_1 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.3 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.3_1 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.4 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.4_1 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.5 2019-12-11T14:17:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.5_1 2019-12-11T14:17:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.6 2019-12-11T14:17:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.246+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.6_1 2019-12-11T14:17:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.7 2019-12-11T14:17:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.7_1 2019-12-11T14:17:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.523+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.8 2019-12-11T14:17:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.523+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.8_1 2019-12-11T14:17:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.523+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.9 2019-12-11T14:17:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.523+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.9_1 2019-12-11T14:17:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.523+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~OXjDBJ27kIl8UWGcsnsFkO6Q73hC32V.10 2019-12-11T14:17:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:02.856+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.020+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:17:03.075 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.083+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.099+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:03.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:17:03.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb', time=2019-12-11T16:05:33.530638+0000, chain.objs.size()=5 2019-12-11T14:17:03.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.27__multipart_key1.2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb.7 2019-12-11T14:17:03.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.27__shadow_key1.2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb.7_1 2019-12-11T14:17:03.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.27__multipart_key1.2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb.10 2019-12-11T14:17:03.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.27__shadow_key1.2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb.10_1 2019-12-11T14:17:03.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.27__multipart_key1.2~AGd9T358s3eqcFJVYjQ0usSTkAvgXxb.13 2019-12-11T14:17:03.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.626', time=2019-12-11T16:11:42.599753+0000, chain.objs.size()=16 2019-12-11T14:17:03.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.1 2019-12-11T14:17:03.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.1_1 2019-12-11T14:17:03.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.1_2 2019-12-11T14:17:03.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.2 2019-12-11T14:17:03.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.2_1 2019-12-11T14:17:03.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.2_2 2019-12-11T14:17:03.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.141+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.3 2019-12-11T14:17:03.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.3_1 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.3_2 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.4 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.4_1 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.4_2 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.5 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.5_1 2019-12-11T14:17:03.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.5_2 2019-12-11T14:17:03.471 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.477+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~aAYYDmV9dszIyUdr1PZAtU5V_Cnqq2h.6 2019-12-11T14:17:03.701 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.708+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:03.876 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.882+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:17:03.944 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.950+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:03.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:03.986+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:03.993 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.001+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:04.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.051+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:17:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.100+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:04.112 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.119+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:04.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:04.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.431', time=2019-12-11T16:02:47.038470+0000, chain.objs.size()=5 2019-12-11T14:17:04.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.19__shadow_.ZvPQtytmkEsvhhEC4M0YIOQL2Shn7Cf_1 2019-12-11T14:17:04.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.19__shadow_.ZvPQtytmkEsvhhEC4M0YIOQL2Shn7Cf_2 2019-12-11T14:17:04.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.19__shadow_.ZvPQtytmkEsvhhEC4M0YIOQL2Shn7Cf_3 2019-12-11T14:17:04.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.19__shadow_.ZvPQtytmkEsvhhEC4M0YIOQL2Shn7Cf_4 2019-12-11T14:17:04.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.135+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.19__shadow_.ZvPQtytmkEsvhhEC4M0YIOQL2Shn7Cf_5 2019-12-11T14:17:04.450 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.458+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:04.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.543+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:17:04.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.601+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:04.626 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.634+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.643+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:04.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.693+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:17:04.727 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.735+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.750+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.455', time=2019-12-11T16:01:55.655042+0000, chain.objs.size()=9 2019-12-11T14:17:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.1 2019-12-11T14:17:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.1_1 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.2 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.2_1 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.3 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.3_1 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.4 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.4_1 2019-12-11T14:17:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.765+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~Hf2RxTPGvwQSM2C4vrXDiAD4Fz91jzt.5 2019-12-11T14:17:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:04.999+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.074+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:17:05.120 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.127+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.148+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:05.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:05.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.467', time=2019-12-11T16:02:42.295359+0000, chain.objs.size()=7 2019-12-11T14:17:05.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.1 2019-12-11T14:17:05.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.1_1 2019-12-11T14:17:05.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.1_2 2019-12-11T14:17:05.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.2 2019-12-11T14:17:05.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.2_1 2019-12-11T14:17:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.2_2 2019-12-11T14:17:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.161+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~PQ5veaOdQfhHRaq89xOe_Ojm25zF0dT.3 2019-12-11T14:17:05.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.358+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:05.419 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.427+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:17:05.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.481+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:05.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.497+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T14:17:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~kLD19debfJEB1tDexCgmvMJqCnrZrZa', time=2019-12-11T15:57:50.824491+0000, chain.objs.size()=9 2019-12-11T14:17:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__multipart_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.1 2019-12-11T14:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__shadow_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.1_1 2019-12-11T14:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__multipart_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.2 2019-12-11T14:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__shadow_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.2_1 2019-12-11T14:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__multipart_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.3 2019-12-11T14:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__shadow_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.3_1 2019-12-11T14:17:05.515 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__multipart_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.4 2019-12-11T14:17:05.515 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__shadow_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.4_1 2019-12-11T14:17:05.515 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.13__multipart_key1.2~kLD19debfJEB1tDexCgmvMJqCnrZrZa.5 2019-12-11T14:17:05.515 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.418', time=2019-12-11T15:59:09.235387+0000, chain.objs.size()=9 2019-12-11T14:17:05.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.1 2019-12-11T14:17:05.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.1_1 2019-12-11T14:17:05.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.520+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.2 2019-12-11T14:17:05.693 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.701+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.2_1 2019-12-11T14:17:05.727 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.734+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.3 2019-12-11T14:17:05.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.3_1 2019-12-11T14:17:05.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.4 2019-12-11T14:17:05.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.4_1 2019-12-11T14:17:05.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.5 2019-12-11T14:17:05.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.634', time=2019-12-11T16:12:57.972916+0000, chain.objs.size()=16 2019-12-11T14:17:05.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.795+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.1 2019-12-11T14:17:05.829 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.836+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.1_1 2019-12-11T14:17:05.829 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.836+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.1_2 2019-12-11T14:17:05.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.837+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.2 2019-12-11T14:17:05.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.837+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.2_1 2019-12-11T14:17:05.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.837+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.2_2 2019-12-11T14:17:05.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:05.837+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.3 2019-12-11T14:17:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.066+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.3_1 2019-12-11T14:17:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.066+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.3_2 2019-12-11T14:17:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.066+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.4 2019-12-11T14:17:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.070+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.4_1 2019-12-11T14:17:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.070+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.4_2 2019-12-11T14:17:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.071+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.5 2019-12-11T14:17:06.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.200+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.5_1 2019-12-11T14:17:06.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.200+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.5_2 2019-12-11T14:17:06.194 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.200+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~_RHT6FkFxw6ANaTD7L5BajUo5-1dSvW.6 2019-12-11T14:17:06.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.402+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:06.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.487+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:17:06.545 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.552+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:06.570 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.577+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:06.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.590+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.627+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:17:06.653 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.660+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.675+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.683+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:06.703 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.710+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:17:06.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.748+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:06.756 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.763+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.558', time=2019-12-11T16:04:51.664829+0000, chain.objs.size()=9 2019-12-11T14:17:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.1 2019-12-11T14:17:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.1_1 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.2 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.2_1 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.3 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.3_1 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.4 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__shadow_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.4_1 2019-12-11T14:17:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:06.776+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.26__multipart_file.mpg.2~mVY3iyDB1yQQq0EkX7TI0HzqfjreDI0.5 2019-12-11T14:17:07.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.034+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:07.125 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.132+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:17:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.229+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:07.263 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.271+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:07.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.461', time=2019-12-11T16:02:18.959372+0000, chain.objs.size()=7 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.1 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.1_1 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.1_2 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.2 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.2_1 2019-12-11T14:17:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.2_2 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~HX1Zq0JAHCPAbbOAuCY-a1NDKHu9ZCU.3 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.510', time=2019-12-11T16:03:40.627134+0000, chain.objs.size()=9 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__multipart_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.1 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__shadow_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.1_1 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__multipart_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.2 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__shadow_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.2_1 2019-12-11T14:17:07.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__multipart_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.3 2019-12-11T14:17:07.644 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.652+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__shadow_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.3_1 2019-12-11T14:17:07.644 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.652+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__multipart_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.4 2019-12-11T14:17:07.645 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.652+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__shadow_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.4_1 2019-12-11T14:17:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.667+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.24__multipart_key1.2~4GPy25p0T3qyr2QFY1GJ6BW9BIKbHYC.5 2019-12-11T14:17:07.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:07.881+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:08.016 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.024+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:17:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.101+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.131+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:08.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:17:08.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.416', time=2019-12-11T15:59:15.193118+0000, chain.objs.size()=9 2019-12-11T14:17:08.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.1 2019-12-11T14:17:08.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.1_1 2019-12-11T14:17:08.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.2 2019-12-11T14:17:08.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.2_1 2019-12-11T14:17:08.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.3 2019-12-11T14:17:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.3_1 2019-12-11T14:17:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.4 2019-12-11T14:17:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__shadow_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.4_1 2019-12-11T14:17:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.17__multipart_key1.2~ubQ1S9IV4UDcpIYbEpFYY4Wv5qUKrm5.5 2019-12-11T14:17:08.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.473', time=2019-12-11T16:02:52.067757+0000, chain.objs.size()=7 2019-12-11T14:17:08.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.1 2019-12-11T14:17:08.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.1_1 2019-12-11T14:17:08.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.180+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.1_2 2019-12-11T14:17:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.398+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.2 2019-12-11T14:17:08.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.425+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.2_1 2019-12-11T14:17:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.505+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.2_2 2019-12-11T14:17:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.547+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~S5J2-PUWpntd9w2Ui15eXTJNDTro-an.3 2019-12-11T14:17:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.682+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.852+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:17:08.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.919+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:08.933 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.940+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.593', time=2019-12-11T16:08:24.203041+0000, chain.objs.size()=21 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.1 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.1_1 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.2 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.2_1 2019-12-11T14:17:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.3 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.3_1 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.4 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.4_1 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.5 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.5_1 2019-12-11T14:17:08.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.6 2019-12-11T14:17:08.967 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:08.971+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.6_1 2019-12-11T14:17:09.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.234+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.7 2019-12-11T14:17:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.234+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.7_1 2019-12-11T14:17:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.234+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.8 2019-12-11T14:17:09.267 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.274+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.8_1 2019-12-11T14:17:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.9 2019-12-11T14:17:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.9_1 2019-12-11T14:17:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.10 2019-12-11T14:17:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.10_1 2019-12-11T14:17:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~VuJprcJv8aXSSOCIb701qjDEUiTFFqq.11 2019-12-11T14:17:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.642', time=2019-12-11T16:13:01.633998+0000, chain.objs.size()=16 2019-12-11T14:17:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.1 2019-12-11T14:17:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.1_1 2019-12-11T14:17:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.1_2 2019-12-11T14:17:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.418+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.2 2019-12-11T14:17:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.418+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.2_1 2019-12-11T14:17:09.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.2_2 2019-12-11T14:17:09.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.3 2019-12-11T14:17:09.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.3_1 2019-12-11T14:17:09.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.3_2 2019-12-11T14:17:09.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.4 2019-12-11T14:17:09.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.4_1 2019-12-11T14:17:09.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.4_2 2019-12-11T14:17:09.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.5 2019-12-11T14:17:09.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.528+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.5_1 2019-12-11T14:17:09.523 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.530+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__shadow_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.5_2 2019-12-11T14:17:09.631 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.638+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.28__multipart_key1.2~H94qy0aBBDOamG8_VW4C2-pOJgoKhf2.6 2019-12-11T14:17:09.916 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:09.923+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:10.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.084+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:17:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.150+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.179+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:10.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:10.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.387', time=2019-12-11T15:58:26.940410+0000, chain.objs.size()=9 2019-12-11T14:17:10.190 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__multipart_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.1 2019-12-11T14:17:10.190 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__shadow_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.1_1 2019-12-11T14:17:10.190 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__multipart_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.2 2019-12-11T14:17:10.190 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__shadow_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.2_1 2019-12-11T14:17:10.190 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__multipart_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.3 2019-12-11T14:17:10.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__shadow_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.3_1 2019-12-11T14:17:10.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__multipart_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.4 2019-12-11T14:17:10.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__shadow_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.4_1 2019-12-11T14:17:10.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.196+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.15__multipart_key1.2~M61mjihQsSaQvqamxagYyNk1qBdkFb6.5 2019-12-11T14:17:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.464+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:10.580 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.587+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:17:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.637+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.645 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.652+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:10.654 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.662+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.689 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.696+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:17:10.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.744+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.759+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:10.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.766+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.812+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:17:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.870+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.882 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.889+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:10.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.903+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:10.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:10.947+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:17:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.009+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.025 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.032+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:11.039 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.529', time=2019-12-11T16:04:12.292885+0000, chain.objs.size()=9 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__multipart_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.1 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__shadow_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.1_1 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__multipart_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.2 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__shadow_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.2_1 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__multipart_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.3 2019-12-11T14:17:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__shadow_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.3_1 2019-12-11T14:17:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__multipart_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.4 2019-12-11T14:17:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__shadow_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.4_1 2019-12-11T14:17:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.046+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.25__multipart_key1.2~m5bZRn9LjrXiQdp2P-o0DDbv9xCjVFf.5 2019-12-11T14:17:11.359 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.366+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.466+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:17:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.510+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.526+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.534+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.575+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:17:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.610+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.618 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.626+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:11.630 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.638+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.660 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.667+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:17:11.731 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.738+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:11.758 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.760+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T14:17:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.672', time=2019-12-11T16:14:52.557920+0000, chain.objs.size()=9 2019-12-11T14:17:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__multipart_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.1 2019-12-11T14:17:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__shadow_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.1_1 2019-12-11T14:17:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__multipart_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.2 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__shadow_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.2_1 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__multipart_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.3 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__shadow_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.3_1 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__multipart_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.4 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__shadow_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.4_1 2019-12-11T14:17:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.30__multipart_key1.2~i8uQSqaG5Zi270lZEytmt5ByRq9Rut4.5 2019-12-11T14:17:11.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS', time=2019-12-11T16:15:14.616564+0000, chain.objs.size()=30 2019-12-11T14:17:11.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.863+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.1 2019-12-11T14:17:11.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.864+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.2 2019-12-11T14:17:11.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:11.864+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.3 2019-12-11T14:17:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.110+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.4 2019-12-11T14:17:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.110+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.5 2019-12-11T14:17:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.110+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.6 2019-12-11T14:17:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.121+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.7 2019-12-11T14:17:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.174+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.8 2019-12-11T14:17:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.174+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.9 2019-12-11T14:17:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.174+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.10 2019-12-11T14:17:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.183+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.11 2019-12-11T14:17:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.183+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.12 2019-12-11T14:17:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.183+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.13 2019-12-11T14:17:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.183+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.14 2019-12-11T14:17:12.194 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.201+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.15 2019-12-11T14:17:12.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.202+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.16 2019-12-11T14:17:12.211 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.218+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.26vESydhGRuLx--ldLHTBSiMac7oqrT.17 2019-12-11T14:17:12.211 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.218+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.4RboKtOZERgko80yU5nfyuoRsB8UgYl.18 2019-12-11T14:17:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.vWgLD3z8yUCB8HI-whHNUTzd-Ouym5b.19 2019-12-11T14:17:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.4Cv8Gcq84_0c5jSPPZM7eOBV-CdNPBb.20 2019-12-11T14:17:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.21 2019-12-11T14:17:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.22 2019-12-11T14:17:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.23 2019-12-11T14:17:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.24 2019-12-11T14:17:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.25 2019-12-11T14:17:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.26 2019-12-11T14:17:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.27 2019-12-11T14:17:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.316+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.28 2019-12-11T14:17:12.356 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.364+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.29 2019-12-11T14:17:12.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.376+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.31__multipart_key1.2~JMV4SrLZ9QVcpBvyeOXh7Wze4k8wzPS.30 2019-12-11T14:17:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.465+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.828', time=2019-12-11T16:16:51.117838+0000, chain.objs.size()=21 2019-12-11T14:17:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.465+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.1 2019-12-11T14:17:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.465+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.1_1 2019-12-11T14:17:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.465+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.2 2019-12-11T14:17:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.465+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.2_1 2019-12-11T14:17:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.474+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.3 2019-12-11T14:17:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.485+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.3_1 2019-12-11T14:17:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.485+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.4 2019-12-11T14:17:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.485+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.4_1 2019-12-11T14:17:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.485+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.5 2019-12-11T14:17:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.485+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.5_1 2019-12-11T14:17:12.624 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.631+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.6 2019-12-11T14:17:12.624 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.631+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.6_1 2019-12-11T14:17:12.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.729+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.7 2019-12-11T14:17:12.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.729+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.7_1 2019-12-11T14:17:12.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.729+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.8 2019-12-11T14:17:12.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.729+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.8_1 2019-12-11T14:17:12.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.736+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.9 2019-12-11T14:17:12.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.744+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.9_1 2019-12-11T14:17:12.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.744+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.10 2019-12-11T14:17:12.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.744+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__shadow_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.10_1 2019-12-11T14:17:12.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:12.744+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.39__multipart_key1.2~imhh2jW45LX7CUAnbIGSnz2ENfDIK24.11 2019-12-11T14:17:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.081+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:13.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.246+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:17:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.311+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.343+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:13.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.357+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.407+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:17:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.460+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.476+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:13.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.484+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.521+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:17:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.561+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.576+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.592+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.614 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.621+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:17:13.653 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.660+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:13.667 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.674+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:17:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.439', time=2019-12-11T16:01:03.337108+0000, chain.objs.size()=9 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.1 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.1_1 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.2 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.2_1 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.3 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.3_1 2019-12-11T14:17:13.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.4 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__shadow_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.4_1 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.20__multipart_key1.2~J3QgjjvO-bdfbO0RFFX_k-pTkWgkygV.5 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.657', time=2019-12-11T16:13:53.349445+0000, chain.objs.size()=9 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__multipart_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.1 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__shadow_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.1_1 2019-12-11T14:17:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.688+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__multipart_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.2 2019-12-11T14:17:13.909 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.916+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__shadow_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.2_1 2019-12-11T14:17:13.945 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.952+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__multipart_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.3 2019-12-11T14:17:13.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.960+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__shadow_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.3_1 2019-12-11T14:17:13.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.960+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__multipart_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.4 2019-12-11T14:17:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:13.973+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__shadow_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.4_1 2019-12-11T14:17:14.185 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.192+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.29__multipart_key1.2~KDqCN7AMuMLdWQ2LqHIh6uxLHRmMZVB.5 2019-12-11T14:17:14.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.305+0000 7f6209056ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:17:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.423+0000 7f6209056ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:17:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.475+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.490+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:14.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.498+0000 7f6209056ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.600+0000 7f6209056ec0 20 remove_watcher() i=0 2019-12-11T14:17:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.600+0000 7f6209056ec0 2 removed watcher, disabling cache 2019-12-11T14:17:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.657+0000 7f6209056ec0 20 remove_watcher() i=1 2019-12-11T14:17:14.686 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.693+0000 7f6209056ec0 20 remove_watcher() i=2 2019-12-11T14:17:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.768+0000 7f6209056ec0 20 remove_watcher() i=3 2019-12-11T14:17:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.820+0000 7f6209056ec0 20 remove_watcher() i=4 2019-12-11T14:17:14.859 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.866+0000 7f6209056ec0 20 remove_watcher() i=5 2019-12-11T14:17:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.928+0000 7f6209056ec0 20 remove_watcher() i=6 2019-12-11T14:17:14.982 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:14.989+0000 7f6209056ec0 20 remove_watcher() i=7 2019-12-11T14:17:14.996 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:17:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.162+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.187+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.188+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.198+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.198+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.204+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.204+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.205 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.212+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.420+0000 7faebd5c1ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:17:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.420+0000 7faebd5c1ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:17:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.420+0000 7faebd5c1ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:17:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.420+0000 7faebd5c1ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:17:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.420+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.431+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:15.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.431+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.450+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.450+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.455 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.462+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:15.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.462+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.470+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.470+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.475+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.475+0000 7faebd5c1ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:17:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.475+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.480+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.480+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.491+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.491+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.502+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:15.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.502+0000 7faebd5c1ec0 20 zonegroup default 2019-12-11T14:17:15.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.502+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.507+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.507+0000 7faebd5c1ec0 10 Cannot find current period zone using local zone 2019-12-11T14:17:15.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.507+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.514+0000 7faebd5c1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.514+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.525+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.525+0000 7faebd5c1ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.543+0000 7faebd5c1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.543+0000 7faebd5c1ec0 20 zone default found 2019-12-11T14:17:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.543+0000 7faebd5c1ec0 20 started sync module instance, tier type = 2019-12-11T14:17:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.543+0000 7faebd5c1ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=0 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=1 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=2 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=3 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=4 2019-12-11T14:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.884+0000 7faebd5c1ec0 20 add_watcher() i=5 2019-12-11T14:17:15.900 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.907+0000 7faebd5c1ec0 20 add_watcher() i=6 2019-12-11T14:17:15.927 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.932+0000 7faebd5c1ec0 20 add_watcher() i=7 2019-12-11T14:17:15.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.932+0000 7faebd5c1ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:17:15.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.932+0000 7fae7afdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:17:15.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.935+0000 7faeaafec700 0 -- >> v2:172.21.15.150:3300/0 conn(0x55930ba0f810 msgr2=0x55930ba22b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:17:15.976 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:15.983+0000 7faeaafec700 0 -- 172.21.15.73:0/3052067615 >> [v2:172.21.15.73:6800/9547,v1:172.21.15.73:6801/9547] conn(0x7fadec022480 msgr2=0x7fadec024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T14:17:17.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.354+0000 7fade97fa700 20 reqs_thread_entry: start 2019-12-11T14:17:17.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.354+0000 7fade2ffd700 20 reqs_thread_entry: start 2019-12-11T14:17:17.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.354+0000 7faebd5c1ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:17:17.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.355+0000 7fade17fa700 20 reqs_thread_entry: start 2019-12-11T14:17:17.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.355+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:17:17.395 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.402+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.416+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.425+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.455+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:17:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.512+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.528+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.537+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.565+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:17:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.667+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.689+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:17.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.704+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.753+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:17:17.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.811+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.839+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.849+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.899+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:17:17.946 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.953+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:17.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.976+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:17.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:17.990+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.016 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.023+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:17:18.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.059+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.067 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.074+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.076 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.083+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.117+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:17:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.156+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.164 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.171+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.179+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.203 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.208+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:17:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.264+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.281+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.289+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.334+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:17:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.392+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.408+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.416+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.455+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:17:18.524 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.531+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.550+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.558+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.614 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.621+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:17:18.657 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.662+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.671 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.677+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.689+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.717+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:17:18.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.754+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.768+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.776+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.809+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:17:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.872+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.891+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:18.894 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.901+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:18.947 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:18.954+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:17:19.019 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.026+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.056+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.070+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.128+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:17:19.168 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.175+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.192+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.205+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.248+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:17:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.331+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.387+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.404+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.448+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:17:19.496 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.503+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.531+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.543+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.591+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:17:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.646+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.664+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.669 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.675+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.704+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:17:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.799+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.832+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.855+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:19.911 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:19.918+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:17:20.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.008+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.071+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.083 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.088+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.134+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:17:20.204 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.209+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.227+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.238+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.287+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:17:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.334+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.354+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.364+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.406+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:17:20.454 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.460+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.477+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.487+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.528+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:17:20.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.568+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.577 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.583+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.587 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.592+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.623+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:17:20.658 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.664+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.680 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.686+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.696+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.731+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:17:20.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.776+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.800+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.814+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.843 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.848+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:17:20.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.904+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.931+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.940+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:20.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:20.984+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:17:21.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.041+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.059+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:21.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.070+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.107+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:17:21.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.185+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.216+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:21.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.228+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.282+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:17:21.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.357+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.382+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:21.389 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.396+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.454+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:17:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.498+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.514+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:21.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.523+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.557 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.563+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:17:21.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.604+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.611 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.618+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.626+0000 7faebd5c1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.731+0000 7faebd5c1ec0 20 remove_watcher() i=0 2019-12-11T14:17:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.731+0000 7faebd5c1ec0 2 removed watcher, disabling cache 2019-12-11T14:17:21.756 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.763+0000 7faebd5c1ec0 20 remove_watcher() i=1 2019-12-11T14:17:21.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.794+0000 7faebd5c1ec0 20 remove_watcher() i=2 2019-12-11T14:17:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.859+0000 7faebd5c1ec0 20 remove_watcher() i=3 2019-12-11T14:17:21.917 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:21.923+0000 7faebd5c1ec0 20 remove_watcher() i=4 2019-12-11T14:17:22.001 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.008+0000 7faebd5c1ec0 20 remove_watcher() i=5 2019-12-11T14:17:22.076 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.083+0000 7faebd5c1ec0 20 remove_watcher() i=6 2019-12-11T14:17:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.125+0000 7faebd5c1ec0 20 remove_watcher() i=7 2019-12-11T14:17:22.125 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:17:22.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.267+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.285 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.292+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.292+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.294 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.301+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.294 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.301+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.305+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.305+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.313+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:22.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.445+0000 7f56d2042ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:17:22.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.445+0000 7f56d2042ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:17:22.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.445+0000 7f56d2042ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:17:22.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.445+0000 7f56d2042ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:17:22.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.445+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.453+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.453+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.463+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.463+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.464 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.471+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:22.464 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.471+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.481+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.481+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.486+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.486+0000 7f56d2042ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:17:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.486+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.507+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.507+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.516+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:22.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.516+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.523+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:22.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.523+0000 7f56d2042ec0 20 zonegroup default 2019-12-11T14:17:22.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.523+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.528+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.528+0000 7f56d2042ec0 10 Cannot find current period zone using local zone 2019-12-11T14:17:22.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.528+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.539+0000 7f56d2042ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:22.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.539+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.547+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:22.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.547+0000 7f56d2042ec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:22.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.565+0000 7f56d2042ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:22.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.565+0000 7f56d2042ec0 20 zone default found 2019-12-11T14:17:22.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.566+0000 7f56d2042ec0 20 started sync module instance, tier type = 2019-12-11T14:17:22.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:22.566+0000 7f56d2042ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:17:23.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=0 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=1 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=2 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=3 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=4 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=5 2019-12-11T14:17:23.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.012+0000 7f56d2042ec0 20 add_watcher() i=6 2019-12-11T14:17:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.059+0000 7f56d2042ec0 20 add_watcher() i=7 2019-12-11T14:17:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.059+0000 7f56d2042ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:17:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.060+0000 7f568ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:17:23.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.070+0000 7f56b6a6b700 0 -- 172.21.15.73:0/3766377768 >> v1:172.21.15.73:6789/0 conn(0x55a6452bd7e0 legacy=0x55a6452bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:17:23.106 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:23.113+0000 7f56bf26c700 0 -- 172.21.15.73:0/1735521032 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x55a6452939c0 msgr2=0x55a6452ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:17:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.719+0000 7f55fe7fc700 20 reqs_thread_entry: start 2019-12-11T14:17:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.719+0000 7f55f7fff700 20 reqs_thread_entry: start 2019-12-11T14:17:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.719+0000 7f56d2042ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:17:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.719+0000 7f55f67fc700 20 reqs_thread_entry: start 2019-12-11T14:17:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.719+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:17:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.785+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.813+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.827+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:24.890 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:24.896+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:17:24.999 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.005+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.035+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.051+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.109+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:17:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.186+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.217+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.232+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.274+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:17:25.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.346+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.373+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.378 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.385+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.432 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.439+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:17:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.494+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.513+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.515 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.522+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.568 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.568+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:17:25.630 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.636+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.675+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.687+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.755+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:17:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.805+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.821 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.828+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.841+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.877 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.881+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:17:25.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.947+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:25.961 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.968+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:25.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:25.977+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.029 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.031+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:17:26.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.076+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.092+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.100+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.134+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:17:26.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.172+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.187+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.196+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.227+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:17:26.257 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.263+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.271 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.278+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.285+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.314+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:17:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.391+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.418+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.437+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.494+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:17:26.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.568+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.599+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.613 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.619+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.655 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.662+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:17:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.723+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.743+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.752+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.801+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:17:26.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.861+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.877 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.884+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.892+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.926+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:17:26.962 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.969+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:26.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.984+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:26.985 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:26.992+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.017 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.022+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:17:27.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.088+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.109+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.125+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.192 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.198+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:17:27.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.268+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.283 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.289+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.300+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.344+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:17:27.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.399+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.408 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.415+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.423+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.478+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:17:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.537+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.556+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.565+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.600+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:17:27.638 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.644+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.669+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.678+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.708+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:17:27.773 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.779+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.803+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.815+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.864 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.870+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:17:27.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.943+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:27.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.972+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:27.978 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:27.984+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.037 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.043+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:17:28.092 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.098+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.117+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.119 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.126+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.175+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:17:28.248 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.254+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.283 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.286+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.296 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.302+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.359+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:17:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.402+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.429+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.443+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.473 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.479+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:17:28.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.524+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.540+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.548+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.586 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.589+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:17:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.696+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.724+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.741+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.797+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:17:28.865 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.871+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.885 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.891+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:28.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.902+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.938+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:17:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:28.989+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.008+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.017+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.046 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.052+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:17:29.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.103+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.116 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.123+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.132+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.168+0000 7f56d2042ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:17:29.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.218+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.235+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.244+0000 7f56d2042ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:29.346 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.352+0000 7f56d2042ec0 20 remove_watcher() i=0 2019-12-11T14:17:29.346 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.352+0000 7f56d2042ec0 2 removed watcher, disabling cache 2019-12-11T14:17:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.401+0000 7f56d2042ec0 20 remove_watcher() i=1 2019-12-11T14:17:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.449+0000 7f56d2042ec0 20 remove_watcher() i=2 2019-12-11T14:17:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.522+0000 7f56d2042ec0 20 remove_watcher() i=3 2019-12-11T14:17:29.575 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.581+0000 7f56d2042ec0 20 remove_watcher() i=4 2019-12-11T14:17:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.635+0000 7f56d2042ec0 20 remove_watcher() i=5 2019-12-11T14:17:29.689 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.695+0000 7f56d2042ec0 20 remove_watcher() i=6 2019-12-11T14:17:29.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.759+0000 7f56d2042ec0 20 remove_watcher() i=7 2019-12-11T14:17:29.764 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:17:29.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.931+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.958+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.958+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:29.960 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.967+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:29.961 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.967+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:29.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.971+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:29.965 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.971+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:29.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:29.978+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.156+0000 7f364153aec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:17:30.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.156+0000 7f364153aec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:17:30.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.156+0000 7f364153aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:17:30.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.156+0000 7f364153aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:17:30.152 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.156+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.166+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.166+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.180+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.180+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.188+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.188+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.198+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.198+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.205+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.205+0000 7f364153aec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:17:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.205+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.210+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.210+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.217+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.217+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.226+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:17:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.226+0000 7f364153aec0 20 zonegroup default 2019-12-11T14:17:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.226+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.231+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.231+0000 7f364153aec0 10 Cannot find current period zone using local zone 2019-12-11T14:17:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.231+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.235+0000 7f364153aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.235+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.246+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:17:30.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.246+0000 7f364153aec0 20 rados->read ofs=0 len=0 2019-12-11T14:17:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.265+0000 7f364153aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:17:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.265+0000 7f364153aec0 20 zone default found 2019-12-11T14:17:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.265+0000 7f364153aec0 20 started sync module instance, tier type = 2019-12-11T14:17:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.265+0000 7f364153aec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:17:30.628 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=0 2019-12-11T14:17:30.628 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=1 2019-12-11T14:17:30.628 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=2 2019-12-11T14:17:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=3 2019-12-11T14:17:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=4 2019-12-11T14:17:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=5 2019-12-11T14:17:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.628+0000 7f364153aec0 20 add_watcher() i=6 2019-12-11T14:17:30.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.663+0000 7f364153aec0 20 add_watcher() i=7 2019-12-11T14:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.663+0000 7f364153aec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.663+0000 7f35fefdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.668+0000 7f362ef65700 0 -- 172.21.15.73:0/1513666377 >> v1:172.21.15.150:6789/0 conn(0x55cb856b0440 legacy=0x55cb856af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:17:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:30.712+0000 7f362df63700 0 -- 172.21.15.73:0/2576199504 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x55cb856e4c20 msgr2=0x55cb856e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:17:32.292 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.298+0000 7f356d7fa700 20 reqs_thread_entry: start 2019-12-11T14:17:32.292 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.298+0000 7f3566ffd700 20 reqs_thread_entry: start 2019-12-11T14:17:32.292 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.298+0000 7f364153aec0 20 init_complete bucket index max shards: 0 2019-12-11T14:17:32.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.299+0000 7f35657fa700 20 reqs_thread_entry: start 2019-12-11T14:17:32.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.299+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:17:32.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.344+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.387+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.398+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.442+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:17:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.499+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.515+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.525+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.561 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.567+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:17:32.635 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.641+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.669+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:32.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.682+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.725+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:17:32.762 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.768+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.784+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:32.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.794+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.820 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.826+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:17:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.900+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.928+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.939+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:32.989+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:17:33.063 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.069+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.092+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.103+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.134+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:17:33.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.179+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.194+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.201+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.237+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:17:33.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.324+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.351+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.362 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.366+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.418+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:17:33.574 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.579+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.608+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.625 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.632+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.677+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:17:33.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.729+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.747+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.756+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.804 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.810+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:17:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.900+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.924 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.930+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.947+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:33.991+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:17:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.037+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.055+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.064+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.095 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.101+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:17:34.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.167+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.185+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.194+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.248+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:17:34.306 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.311+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.340+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.353+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.397+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:17:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.452+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.473+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.483+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.530+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:17:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.591+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.615+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.627+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.670+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:17:34.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.722+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.738+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.747+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.775+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:17:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.851+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.879+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:34.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.900+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:34.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.940+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:17:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:34.993+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.015+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.027+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.065 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.070+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:17:35.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.129+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.142 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.146+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.150 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.155+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.206+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:17:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.248+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.257 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.263+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.270+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.297+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:17:35.332 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.337+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.354+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.363+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.390 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.395+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:17:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.437+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.457+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.466+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.515+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:17:35.586 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.592+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.628+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.646+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.702+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:17:35.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.776+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.804+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.816+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.870+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:17:35.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.920+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.934 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.941+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:35.945 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.951+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:35.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:35.989+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:17:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.056+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.075 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.081+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.087 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.093+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.132+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:17:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.179+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.197+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.202 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.207+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.252+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:17:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.306+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.322+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.330+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.381+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:17:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.443+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.460+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.468+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.507+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:17:36.550 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.557+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.566 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.572+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.583+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.618+0000 7f364153aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:17:36.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.670+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.685 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.691+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:17:36.695 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.701+0000 7f364153aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:17:36.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.800+0000 7f364153aec0 20 remove_watcher() i=0 2019-12-11T14:17:36.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.800+0000 7f364153aec0 2 removed watcher, disabling cache 2019-12-11T14:17:36.839 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.845+0000 7f364153aec0 20 remove_watcher() i=1 2019-12-11T14:17:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.882+0000 7f364153aec0 20 remove_watcher() i=2 2019-12-11T14:17:36.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.943+0000 7f364153aec0 20 remove_watcher() i=3 2019-12-11T14:17:36.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:36.979+0000 7f364153aec0 20 remove_watcher() i=4 2019-12-11T14:17:37.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:37.036+0000 7f364153aec0 20 remove_watcher() i=5 2019-12-11T14:17:37.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:37.083+0000 7f364153aec0 20 remove_watcher() i=6 2019-12-11T14:17:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:17:37.137+0000 7f364153aec0 20 remove_watcher() i=7 2019-12-11T14:17:37.141 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-12-11T14:17:37.904 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean 2019-12-11T14:17:38.602 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2019-12-11T14:17:38.603 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2019-12-11T14:17:38.603 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:38.804 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2019-12-11T14:17:38.805 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2019-12-11T14:17:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:41.303 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2019-12-11T14:17:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:41.306 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-12-11T14:17:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:43.903 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-12-11T14:17:50.403 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:50.403 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-12-11T14:17:53.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:53.804 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-12-11T14:17:59.303 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:17:59.303 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-12-11T14:18:01.103 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:01.103 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-12-11T14:18:06.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:06.803 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-12-11T14:18:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:13.404 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-12-11T14:18:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:14.104 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-12-11T14:18:18.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:18.304 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-12-11T14:18:24.604 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:24.604 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-12-11T14:18:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:25.104 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-12-11T14:18:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:26.604 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-12-11T14:18:32.504 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:32.504 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-12-11T14:18:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:44.605 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-12-11T14:18:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:48.105 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-12-11T14:18:52.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:52.505 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-12-11T14:18:53.010 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:53.010 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-12-11T14:18:54.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------- 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------- 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 1m 17s 2019-12-11T14:18:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 5 executed 2019-12-11T14:18:54.380 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:18:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.536+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.566+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.566+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.575+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.575+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.579 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.582+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.579 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.582+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.587 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.590+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:18:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.768+0000 7f730fa21ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:18:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.768+0000 7f730fa21ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:18:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.768+0000 7f730fa21ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:18:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.768+0000 7f730fa21ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:18:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.768+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.776+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:18:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.777+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.791+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:18:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.791+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.797+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:18:54.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.797+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.803 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.806+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:18:54.803 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.806+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.811+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.811+0000 7f730fa21ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:18:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.811+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.812 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.816+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.816+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.820 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.823+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:18:54.820 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.823+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.831+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:18:54.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.831+0000 7f730fa21ec0 20 zonegroup default 2019-12-11T14:18:54.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.831+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.837+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.837+0000 7f730fa21ec0 10 Cannot find current period zone using local zone 2019-12-11T14:18:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.837+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.841+0000 7f730fa21ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:18:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.841+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.849+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:18:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.849+0000 7f730fa21ec0 20 rados->read ofs=0 len=0 2019-12-11T14:18:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.868+0000 7f730fa21ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:18:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.868+0000 7f730fa21ec0 20 zone default found 2019-12-11T14:18:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.868+0000 7f730fa21ec0 20 started sync module instance, tier type = 2019-12-11T14:18:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:54.868+0000 7f730fa21ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:18:55.354 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.356+0000 7f72fcc4b700 0 -- 172.21.15.73:0/1654563612 >> [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] conn(0x56041eb80150 msgr2=0x56041eb82570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:18:55.354 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=0 2019-12-11T14:18:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=1 2019-12-11T14:18:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=2 2019-12-11T14:18:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=3 2019-12-11T14:18:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=4 2019-12-11T14:18:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.357+0000 7f730fa21ec0 20 add_watcher() i=5 2019-12-11T14:18:55.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.427+0000 7f730fa21ec0 20 add_watcher() i=6 2019-12-11T14:18:55.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.427+0000 7f730fa21ec0 20 add_watcher() i=7 2019-12-11T14:18:55.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.427+0000 7f730fa21ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:18:55.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.427+0000 7f72ccfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:18:55.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:55.477+0000 7f72fd44c700 0 -- 172.21.15.73:0/1913881847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56041eb88890 msgr2=0x56041eb87c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:18:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.099+0000 7f723effd700 20 reqs_thread_entry: start 2019-12-11T14:18:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.100+0000 7f723cff9700 20 reqs_thread_entry: start 2019-12-11T14:18:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.100+0000 7f730fa21ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:18:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.100+0000 7f7232ffd700 20 reqs_thread_entry: start 2019-12-11T14:18:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.100+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:18:57.142 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.145+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.166+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:57.174 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.178+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.209+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:18:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.335+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.370+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:57.395 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.398+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.443+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:18:57.519 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.522+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.543+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:57.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.555+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.613+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:18:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.840+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.869+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.881+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:57.932 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:57.934+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:18:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.072+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.091 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.094+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.103+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.131+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:18:58.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.183+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.200+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.209+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.235+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:18:58.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.271+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.295 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.298+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.305 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.308+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.340+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:18:58.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.406+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.430+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.443+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.483+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:18:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.527+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.544+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.553 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.553+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.620+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:18:58.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.675+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.693+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.698 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.701+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.736+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:18:58.779 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.782+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.811+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.820+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.864+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:18:58.909 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.912+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.928+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:58.933 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.936+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:58.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:58.978+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:18:59.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.031+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.046+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.051 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.054+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.121+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:18:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.184+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.204+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.215 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.218+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.263+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:18:59.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.322+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.341+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.351+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.398 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.401+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:18:59.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.454+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.472+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.481+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.512 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.514+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:18:59.564 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.567+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.579 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.581+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.587 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.590+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.615 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.617+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:18:59.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.675+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.686 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.689+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.695 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.698+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.743+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:18:59.802 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.805+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.841+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.857+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.915+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:18:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.961+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:18:59.977 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.980+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:18:59.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:18:59.992+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.024+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:19:00.094 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.097+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.132+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.146+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.197+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:19:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.247+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.265+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.279+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.339+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:19:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.394+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.414+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.430+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.468+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:19:00.546 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.549+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.581+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.595+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.650+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:19:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.713+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.746+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.767+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.830+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:19:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.894+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.928+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:00.946+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.000+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:19:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.083+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.120+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.136+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.180 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.183+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:19:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.236+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.252+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.262+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.301+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:19:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.374+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.397+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.407 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.410+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.466+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:19:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.536+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.570+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.583+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.622+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:19:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.693+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.714+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.725+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.772 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.774+0000 7f730fa21ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:19:01.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.852+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.888 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.890+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:01.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.907+0000 7f730fa21ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:01.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.993+0000 7f730fa21ec0 20 remove_watcher() i=0 2019-12-11T14:19:01.991 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:01.993+0000 7f730fa21ec0 2 removed watcher, disabling cache 2019-12-11T14:19:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.035+0000 7f730fa21ec0 20 remove_watcher() i=1 2019-12-11T14:19:02.101 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.104+0000 7f730fa21ec0 20 remove_watcher() i=2 2019-12-11T14:19:02.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.161+0000 7f730fa21ec0 20 remove_watcher() i=3 2019-12-11T14:19:02.215 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.218+0000 7f730fa21ec0 20 remove_watcher() i=4 2019-12-11T14:19:02.257 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.259+0000 7f730fa21ec0 20 remove_watcher() i=5 2019-12-11T14:19:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.319+0000 7f730fa21ec0 20 remove_watcher() i=6 2019-12-11T14:19:02.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.370+0000 7f730fa21ec0 20 remove_watcher() i=7 2019-12-11T14:19:02.377 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:19:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.507+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.531+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.531+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.540+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.540+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.544+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.544+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.555+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:02.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.751+0000 7ff49ef7fec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:19:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.751+0000 7ff49ef7fec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:19:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.751+0000 7ff49ef7fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:19:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.751+0000 7ff49ef7fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:19:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.751+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.766+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.766+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.783+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.784+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.795+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.795+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.810+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:02.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.810+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.816+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.816+0000 7ff49ef7fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:19:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.816+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.822+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.822+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.833+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.833+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.846+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.846+0000 7ff49ef7fec0 20 zonegroup default 2019-12-11T14:19:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.846+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.851+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.851+0000 7ff49ef7fec0 10 Cannot find current period zone using local zone 2019-12-11T14:19:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.851+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.858+0000 7ff49ef7fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:02.856 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.858+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.869+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:02.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.869+0000 7ff49ef7fec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.888+0000 7ff49ef7fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.888+0000 7ff49ef7fec0 20 zone default found 2019-12-11T14:19:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.888+0000 7ff49ef7fec0 20 started sync module instance, tier type = 2019-12-11T14:19:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:02.888+0000 7ff49ef7fec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:19:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=0 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=1 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=2 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=3 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=4 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=5 2019-12-11T14:19:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.318+0000 7ff49ef7fec0 20 add_watcher() i=6 2019-12-11T14:19:03.347 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.349+0000 7ff49ef7fec0 20 add_watcher() i=7 2019-12-11T14:19:03.347 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.349+0000 7ff49ef7fec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:19:03.347 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.349+0000 7ff45cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:19:03.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.353+0000 7ff483fff700 0 -- 172.21.15.73:0/857274632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5602a163ccf0 msgr2=0x5602a163d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-11T14:19:03.402 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:03.404+0000 7ff48c1a9700 0 -- 172.21.15.73:0/1709122731 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x5602a1669f40 msgr2=0x5602a166c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:19:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.043+0000 7ff3ceffd700 20 reqs_thread_entry: start 2019-12-11T14:19:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.043+0000 7ff3ccff9700 20 reqs_thread_entry: start 2019-12-11T14:19:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.043+0000 7ff49ef7fec0 20 init_complete bucket index max shards: 0 2019-12-11T14:19:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.044+0000 7ff3c2ffd700 20 reqs_thread_entry: start 2019-12-11T14:19:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.044+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:19:05.103 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.106+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.123+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.131+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.176+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:19:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.239+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.255+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.264+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.314+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:19:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.382+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.422+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.468+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.516+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:19:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.575+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.599+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.612+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.662 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.662+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:19:05.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.719+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.735 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.737+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.749+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.796+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:19:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.857+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.876+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:05.885 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.888+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.927 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.930+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:19:05.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:05.985+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.001+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.014+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.062+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:19:06.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.102+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.121+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.131+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.159+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:19:06.209 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.211+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.227+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.235+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.270 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.272+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:19:06.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.330+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.346 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.349+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.365 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.361+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.400 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.402+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:19:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.488+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.528+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.548 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.550+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.637 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.638+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:19:06.693 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.695+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.714+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.727+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.772 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.769+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:19:06.852 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.854+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.884 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.887+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.901+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:06.974+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:19:07.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.051+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.085 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.087+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.104+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.178+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:19:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.235+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.254+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.263+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.291+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:19:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.371+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.402+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.421+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.469+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:19:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.543+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.563+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.574+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.624+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:19:07.677 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.679+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.700+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.707 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.710+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.749+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:19:07.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.809+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.836+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.856+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.897 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.900+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:19:07.950 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.953+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.968+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:07.978+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.011+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:19:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.065+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.080+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.086 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.088+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.130+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:19:08.191 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.194+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.221+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.234 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.236+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.283+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:19:08.352 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.355+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.377 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.376+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.387+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.444+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:19:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.494+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.513+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.524+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.595 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.597+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:19:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.646+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.662 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.664+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.673+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.703+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:19:08.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.779+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.812+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.825+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.890 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.892+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:19:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.941+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.961+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:08.973+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.025+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:19:09.084 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.087+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.108 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.110+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.122+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.169+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:19:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.212+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.229+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:09.241 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.239+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.275+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:19:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.320+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.335+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:09.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.343+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.400+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:19:09.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.436+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.451+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.459+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.497+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:19:09.579 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.581+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.608 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.610+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:09.623 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.626+0000 7ff49ef7fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:09.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.718+0000 7ff49ef7fec0 20 remove_watcher() i=0 2019-12-11T14:19:09.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.718+0000 7ff49ef7fec0 2 removed watcher, disabling cache 2019-12-11T14:19:09.763 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.765+0000 7ff49ef7fec0 20 remove_watcher() i=1 2019-12-11T14:19:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.806+0000 7ff49ef7fec0 20 remove_watcher() i=2 2019-12-11T14:19:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.880+0000 7ff49ef7fec0 20 remove_watcher() i=3 2019-12-11T14:19:09.921 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.923+0000 7ff49ef7fec0 20 remove_watcher() i=4 2019-12-11T14:19:09.961 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.962+0000 7ff49ef7fec0 20 remove_watcher() i=5 2019-12-11T14:19:09.994 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:09.995+0000 7ff49ef7fec0 20 remove_watcher() i=6 2019-12-11T14:19:10.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.049+0000 7ff49ef7fec0 20 remove_watcher() i=7 2019-12-11T14:19:10.057 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:19:10.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.340+0000 7fc3b3fff700 0 --2- 172.21.15.73:0/3114800681 >> v2:172.21.15.73:3300/0 conn(0x555bad221bc0 0x555bad221fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T14:19:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.382+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.428+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.428 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.428+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.441+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.441+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.462+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.462+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.476 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.478+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.671+0000 7fc3cf332ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:19:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.671+0000 7fc3cf332ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:19:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.671+0000 7fc3cf332ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:19:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.671+0000 7fc3cf332ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:19:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.671+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.682+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:10.681 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.682+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.698 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.700+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:10.698 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.700+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.708 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.709+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:10.708 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.709+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.718+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:10.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.718+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.725+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.725+0000 7fc3cf332ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:19:10.724 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.725+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.731+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.731+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.743 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.744+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:10.743 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.744+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.753+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:10.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.753+0000 7fc3cf332ec0 20 zonegroup default 2019-12-11T14:19:10.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.753+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.760+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.760+0000 7fc3cf332ec0 10 Cannot find current period zone using local zone 2019-12-11T14:19:10.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.760+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.763 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.765+0000 7fc3cf332ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:10.763 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.765+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.771+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:10.770 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.771+0000 7fc3cf332ec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.795+0000 7fc3cf332ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.795+0000 7fc3cf332ec0 20 zone default found 2019-12-11T14:19:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.795+0000 7fc3cf332ec0 20 started sync module instance, tier type = 2019-12-11T14:19:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:10.795+0000 7fc3cf332ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:19:11.092 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.093+0000 7fc3bc55c700 0 -- 172.21.15.73:0/379122580 >> [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] conn(0x555bad314de0 msgr2=0x555bad317200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:19:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=0 2019-12-11T14:19:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=1 2019-12-11T14:19:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=2 2019-12-11T14:19:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=3 2019-12-11T14:19:11.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=4 2019-12-11T14:19:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=5 2019-12-11T14:19:11.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.442+0000 7fc3cf332ec0 20 add_watcher() i=6 2019-12-11T14:19:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.485+0000 7fc3cf332ec0 20 add_watcher() i=7 2019-12-11T14:19:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.485+0000 7fc3cf332ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:19:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.485+0000 7fc38cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:19:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:11.511+0000 7fc3b3fff700 0 -- 172.21.15.73:0/3104862952 >> v1:172.21.15.150:6789/0 conn(0x555bad31f190 legacy=0x555bad3651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:19:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.876+0000 7fc2feffd700 20 reqs_thread_entry: start 2019-12-11T14:19:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.876+0000 7fc2fcff9700 20 reqs_thread_entry: start 2019-12-11T14:19:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.876+0000 7fc3cf332ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:19:12.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.877+0000 7fc2f2ffd700 20 reqs_thread_entry: start 2019-12-11T14:19:12.875 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.877+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:19:12.931 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.933+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:12.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.955+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:12.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:12.967+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.138+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:19:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.203+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.222+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.232+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.273+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:19:13.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.327+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.342+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.350+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.396+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:19:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.445+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.458 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.460+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.468+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.512+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:19:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.596+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.614 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.616+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.635+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.691+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:19:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.744+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.762 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.765+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.773+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.800 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.802+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:19:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.844+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.859+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.867 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.866+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.897 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.899+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:19:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.951+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.970+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:13.982+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.028+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:19:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.096+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.128+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.144 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.146+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.209+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:19:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.261+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.280 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.282+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.290 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.293+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.325+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:19:14.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.414+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.455 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.457+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.470+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.514+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:19:14.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.564+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.581 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.583+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.591+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.626 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.628+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:19:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.673+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.686 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.689+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.696+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.724+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:19:14.801 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.803+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.830+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:14.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.844+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.902+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:19:14.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.973+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:14.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:14.994+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.004+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.076+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:19:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.159+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.180 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.182+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.191+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.261 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.263+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:19:15.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.341+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.370+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.384+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.433+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:19:15.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.484+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.499 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.501+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.511+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.558+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:19:15.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.635+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.652+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.661+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.710 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.712+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:19:15.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.799+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.831+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.846+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.899+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:19:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.968+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:15.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:15.991+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.005 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.008+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.058+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:19:16.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.115+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.138+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.144 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.146+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.183 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.185+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:19:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.227+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.240 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.242+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.249 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.251+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.286+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:19:16.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.373+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.413+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.427+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.486+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:19:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.563+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.585+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.596+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.651+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:19:16.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.699+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.713 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.716+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.727+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.772 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.774+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:19:16.814 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.816+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.831+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.840+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.868 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.870+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:19:16.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.914+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.932+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:16.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:16.945+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.008 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.010+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:19:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.066+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.085+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.094+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.133 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.135+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:19:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.213+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.246+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.264+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.325+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:19:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.399+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.429+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.451+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.505+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:19:17.566 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.568+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.591+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:17.604 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.605+0000 7fc3cf332ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.718+0000 7fc3cf332ec0 20 remove_watcher() i=0 2019-12-11T14:19:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.718+0000 7fc3cf332ec0 2 removed watcher, disabling cache 2019-12-11T14:19:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.771+0000 7fc3cf332ec0 20 remove_watcher() i=1 2019-12-11T14:19:17.811 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.812+0000 7fc3cf332ec0 20 remove_watcher() i=2 2019-12-11T14:19:17.872 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.875+0000 7fc3cf332ec0 20 remove_watcher() i=3 2019-12-11T14:19:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.929+0000 7fc3cf332ec0 20 remove_watcher() i=4 2019-12-11T14:19:17.992 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:17.994+0000 7fc3cf332ec0 20 remove_watcher() i=5 2019-12-11T14:19:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.049+0000 7fc3cf332ec0 20 remove_watcher() i=6 2019-12-11T14:19:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.102+0000 7fc3cf332ec0 20 remove_watcher() i=7 2019-12-11T14:19:18.109 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:19:18.235 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.237+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.272+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.272+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.281+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.279 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.281+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.285 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.288+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.288+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.294 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.297+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.483+0000 7fadc4a8aec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:19:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.483+0000 7fadc4a8aec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:19:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.483+0000 7fadc4a8aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:19:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.483+0000 7fadc4a8aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:19:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.483+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.490+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.491+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.504+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.504+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.514+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.514+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.522 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.524+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:18.523 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.524+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.530+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.530+0000 7fadc4a8aec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.530+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.537+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.537+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.544+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.544+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.553+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:19:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.553+0000 7fadc4a8aec0 20 zonegroup default 2019-12-11T14:19:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.553+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.555 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.557+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.555 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.557+0000 7fadc4a8aec0 10 Cannot find current period zone using local zone 2019-12-11T14:19:18.556 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.557+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.560 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.562+0000 7fadc4a8aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:19:18.560 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.562+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.569+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:19:18.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.569+0000 7fadc4a8aec0 20 rados->read ofs=0 len=0 2019-12-11T14:19:18.576 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.578+0000 7fadc4a8aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:19:18.576 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.578+0000 7fadc4a8aec0 20 zone default found 2019-12-11T14:19:18.576 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.578+0000 7fadc4a8aec0 20 started sync module instance, tier type = 2019-12-11T14:19:18.576 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:18.578+0000 7fadc4a8aec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=0 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=1 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=2 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=3 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=4 2019-12-11T14:19:19.002 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.003+0000 7fadc4a8aec0 20 add_watcher() i=5 2019-12-11T14:19:19.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.013+0000 7fadc4a8aec0 20 add_watcher() i=6 2019-12-11T14:19:19.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.054+0000 7fadc4a8aec0 20 add_watcher() i=7 2019-12-11T14:19:19.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.054+0000 7fadc4a8aec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:19:19.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.054+0000 7fad827dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:19:19.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.058+0000 7fadb14b3700 0 -- 172.21.15.73:0/1042817669 >> v2:172.21.15.73:3300/0 conn(0x563af7ac0780 msgr2=0x563af7ac2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:19:19.086 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.088+0000 7fadb24b5700 0 -- 172.21.15.73:0/567382087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563af7a8a160 msgr2=0x563af7a8c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:19:19.288 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:19.290+0000 7fadb24b5700 0 --2- 172.21.15.73:0/567382087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563af7a8a160 0x563af7a8c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T14:19:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:20.943+0000 7facf8ff9700 20 reqs_thread_entry: start 2019-12-11T14:19:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:20.943+0000 7facf27fc700 20 reqs_thread_entry: start 2019-12-11T14:19:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:20.943+0000 7fadc4a8aec0 20 init_complete bucket index max shards: 0 2019-12-11T14:19:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:20.943+0000 7facf0ff9700 20 reqs_thread_entry: start 2019-12-11T14:19:20.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:20.943+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:19:21.014 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.016+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.042 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.044+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.067 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.069+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.120+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:19:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.171+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.188+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.199+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.239+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:19:21.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.295+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.324+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.344+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.384+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:19:21.454 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.456+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.478+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.492+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.535 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.537+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:19:21.593 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.595+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.621+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.631 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.633+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.675 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.677+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:19:21.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.762+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.778+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.787+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.837 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.839+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:19:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.927+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:21.964 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.966+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:21.981 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:21.983+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.036 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.038+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:19:22.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.256+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.280+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:22.288 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.289+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.342+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:19:22.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.417+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.442 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.444+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:22.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.462+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.502+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:19:22.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.543+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.557 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.559+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.569+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.603 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.605+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:19:22.677 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.679+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.708+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:22.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.727+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.774 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.776+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:19:22.832 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.834+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.857+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:22.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.868+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.922+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:19:22.987 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:22.989+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.008 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.010+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.023+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.066 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.068+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:19:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.124+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.140 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.142+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.154+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.188+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:19:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.228+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.245 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.247+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.267 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.268+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.302+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:19:23.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.341+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.354 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.356+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.363 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.365+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.396+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:19:23.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.475+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.503 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.505+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.524 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.526+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.591+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:19:23.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.692+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.715 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.717+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.727 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.729+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.772 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.774+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:19:23.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.829+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.856 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.858+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:23.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.871+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:23.924 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.926+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:19:23.987 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:23.988+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.005 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.006+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.021+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.059+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:19:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.113+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.145+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.153+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.193+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:19:24.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.253+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.270+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.280+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.344+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:19:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.421+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.445+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.460+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.511 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.513+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:19:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.569+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.586+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.596 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.598+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.638+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:19:24.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.685+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.698 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.700+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.707 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.709+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.735+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:19:24.768 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.769+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.787+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.797+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.823+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:19:24.872 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.874+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.886 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.888+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:24.894 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.896+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:24.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:24.939+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:19:25.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.011+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.043+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:25.059 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.061+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.125+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:19:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.189+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.209+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.219+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.251+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:19:25.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.324+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.350 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.351+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:25.364 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.366+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.412+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:19:25.457 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.459+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.484+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.502+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.541+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:19:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.581+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.596+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:19:25.603 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.605+0000 7fadc4a8aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:19:25.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.701+0000 7fadc4a8aec0 20 remove_watcher() i=0 2019-12-11T14:19:25.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.701+0000 7fadc4a8aec0 2 removed watcher, disabling cache 2019-12-11T14:19:25.747 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.749+0000 7fadc4a8aec0 20 remove_watcher() i=1 2019-12-11T14:19:25.779 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.780+0000 7fadc4a8aec0 20 remove_watcher() i=2 2019-12-11T14:19:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.866+0000 7fadc4a8aec0 20 remove_watcher() i=3 2019-12-11T14:19:25.909 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.911+0000 7fadc4a8aec0 20 remove_watcher() i=4 2019-12-11T14:19:25.951 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.953+0000 7fadc4a8aec0 20 remove_watcher() i=5 2019-12-11T14:19:25.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:25.999+0000 7fadc4a8aec0 20 remove_watcher() i=6 2019-12-11T14:19:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:19:26.040+0000 7fadc4a8aec0 20 remove_watcher() i=7 2019-12-11T14:19:26.044 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-12-11T14:19:26.713 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean 2019-12-11T14:19:27.310 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2019-12-11T14:19:27.310 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2019-12-11T14:19:27.310 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2019-12-11T14:19:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2019-12-11T14:19:27.511 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2019-12-11T14:19:29.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:29.910 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2019-12-11T14:19:29.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:29.910 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-12-11T14:19:30.493 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:37:30.716 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.502 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:37:30.725 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.510 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:37:30.733 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.513 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:37:30.737 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.514 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:37:30.688 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.518 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:37:30.692 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.658 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:37:30.881 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.684 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:37:30.908 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:30.699 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:37:30.872 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:19:33.710 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:33.710 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-12-11T14:19:43.810 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:43.810 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-12-11T14:19:45.814 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:45.814 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-12-11T14:19:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:52.910 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-12-11T14:19:55.510 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:19:55.510 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-12-11T14:20:01.010 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:01.011 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-12-11T14:20:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:22.611 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-12-11T14:20:29.711 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:29.712 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-12-11T14:20:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:31.711 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-12-11T14:20:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:36.611 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-12-11T14:20:40.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:40.612 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-12-11T14:20:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:47.112 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-12-11T14:20:47.412 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:47.412 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-12-11T14:20:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:48.312 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-12-11T14:20:49.812 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:49.812 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-12-11T14:20:55.712 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:20:55.712 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-12-11T14:21:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:01.212 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-12-11T14:21:07.812 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:07.812 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-12-11T14:21:09.912 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:09.913 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-12-11T14:21:16.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:16.213 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-12-11T14:21:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:18.613 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-12-11T14:21:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:28.413 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-12-11T14:21:29.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:29.913 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-12-11T14:21:35.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:35.413 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-12-11T14:21:37.813 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:37.813 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-12-11T14:21:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:43.013 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-12-11T14:21:45.413 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:45.413 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-12-11T14:21:51.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:51.313 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-12-11T14:21:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:54.014 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-12-11T14:21:59.813 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:21:59.813 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-12-11T14:22:05.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:22:05.713 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-12-11T14:22:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:22:11.813 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-12-11T14:22:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:22:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-12-11T14:22:41.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:22:41.714 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-12-11T14:24:37.188 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:37.406 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.225 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:37.443 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.257 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:37.476 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.261 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:37.480 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.289 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:37.461 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.295 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:37.468 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.380 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:37.598 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.409 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:37.627 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:37.468 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:37.641 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.344 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:42.562 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.347 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:42.566 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.361 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:42.534 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.363 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:42.582 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.366 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:42.584 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.368 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:42.541 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.374 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:42:42.592 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.384 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:42:42.603 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:24:42.414 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:42:42.586 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:26:30.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:26:30.716 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-12-11T14:26:45.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:26:45.716 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-12-11T14:26:48.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:26:48.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-12-11T14:26:55.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:26:55.116 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-12-11T14:26:58.616 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:26:58.616 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-12-11T14:27:08.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:08.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-12-11T14:27:20.717 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:20.717 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-12-11T14:27:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-12-11T14:27:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:28.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-12-11T14:27:29.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:29.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-12-11T14:27:57.368 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T14:27:57.311+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T14:27:58.717 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:27:58.717 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-12-11T14:28:09.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:28:09.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-12-11T14:28:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:28:22.917 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-12-11T14:28:35.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:28:35.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-12-11T14:29:11.616 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:29:11.617 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-12-11T14:29:19.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:29:19.116 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-12-11T14:29:54.798 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:47:55.014 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.802 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:47:55.018 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.812 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:47:55.029 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.817 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:47:54.987 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.818 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:47:55.034 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.832 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:47:55.002 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:54.973 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:47:55.189 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:55.001 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:47:55.217 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:29:55.022 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:47:55.192 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:31:30.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:31:30.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-12-11T14:31:36.916 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:31:36.917 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-12-11T14:32:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:32:22.548 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-12-11T14:32:31.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:32:31.117 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-12-11T14:32:58.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:32:58.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-12-11T14:32:58.685 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:50:58.901 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.720 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:50:58.936 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.730 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:58.946 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.732 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:58.948 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.743 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:50:58.911 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.747 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:50:58.915 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.805 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:50:59.022 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.832 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:50:59.000 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:32:58.855 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:50:59.071 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:33:04.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:04.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-12-11T14:33:11.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:11.617 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-12-11T14:33:20.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:20.417 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-12-11T14:33:20.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-12-11T14:33:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:22.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-12-11T14:33:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:23.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-12-11T14:33:26.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:26.417 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-12-11T14:33:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:28.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-12-11T14:33:32.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:32.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-12-11T14:33:33.923 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:33.924 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-12-11T14:33:36.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:36.917 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-12-11T14:33:38.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:38.617 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-12-11T14:33:42.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:42.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-12-11T14:33:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:44.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-12-11T14:33:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:48.417 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-12-11T14:33:51.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:51.217 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-12-11T14:33:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:55.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-12-11T14:33:59.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:33:59.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-12-11T14:34:06.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:06.617 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-12-11T14:34:12.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:12.818 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-12-11T14:34:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:22.918 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-12-11T14:34:31.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:31.217 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-12-11T14:34:40.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:40.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-12-11T14:34:45.618 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:45.618 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-12-11T14:34:55.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:55.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-12-11T14:34:59.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:34:59.318 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-12-11T14:35:06.204 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:53:06.420 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.212 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:53:06.428 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.223 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:53:06.438 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.230 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:53:06.443 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.233 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:53:06.401 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.238 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:53:06.407 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.311 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:53:06.526 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.316 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:53:06.532 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:06.339 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:53:06.508 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:35:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:08.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-12-11T14:35:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:14.217 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-12-11T14:35:24.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:24.319 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-12-11T14:35:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:28.818 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-12-11T14:35:38.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:38.318 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-12-11T14:35:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:45.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-12-11T14:35:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:35:55.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-12-11T14:36:00.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:00.818 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-12-11T14:36:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:11.818 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-12-11T14:36:20.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:20.518 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-12-11T14:36:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:29.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-12-11T14:36:35.218 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:35.219 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-12-11T14:36:45.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:45.919 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-12-11T14:36:53.018 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:36:53.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-12-11T14:37:04.218 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:04.218 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-12-11T14:37:09.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:09.518 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-12-11T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-12-11T14:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-12-11T14:37:35.618 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:35.618 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-12-11T14:37:41.618 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:41.618 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-12-11T14:37:51.018 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:51.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-12-11T14:37:57.118 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:37:57.118 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-12-11T14:38:09.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:09.018 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-12-11T14:38:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:15.818 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-12-11T14:38:24.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:24.917 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-12-11T14:38:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:32.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-12-11T14:38:43.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:43.117 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-12-11T14:38:51.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:38:51.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-12-11T14:39:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:02.117 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-12-11T14:39:08.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:08.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-12-11T14:39:19.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:19.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-12-11T14:39:24.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:24.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-12-11T14:39:32.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:32.517 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-12-11T14:39:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:38.117 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-12-11T14:39:48.222 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:48.226 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-12-11T14:39:53.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:39:53.817 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-12-11T14:40:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:01.917 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-12-11T14:40:04.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:04.217 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-12-11T14:40:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:10.217 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-12-11T14:40:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:13.417 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-12-11T14:40:17.125 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:58:17.341 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.130 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:58:17.347 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.136 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:58:17.352 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.139 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:58:17.356 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.141 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:58:17.312 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.148 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:58:17.318 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.314 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:58:17.530 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.327 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:58:17.498 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:17.377 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:58:17.588 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:40:18.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:18.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-12-11T14:40:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:22.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-12-11T14:40:30.016 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:30.017 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-12-11T14:40:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:33.216 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-12-11T14:40:42.619 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:42.620 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-12-11T14:40:50.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:50.816 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-12-11T14:40:57.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:57.316 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-12-11T14:40:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:58.316 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-12-11T14:40:59.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:40:59.116 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-12-11T14:41:02.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:02.317 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-12-11T14:41:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:08.618 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-12-11T14:41:13.016 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:13.016 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-12-11T14:41:20.166 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:59:20.383 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.173 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:59:20.390 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.213 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:20.430 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.241 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:20.457 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.241 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:59:20.412 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.249 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:59:20.420 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.250 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:00:59:20.467 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.283 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:59:20.496 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.325 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:00:59:20.496 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:41:20.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:20.416 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-12-11T14:41:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:22.116 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-12-11T14:41:27.616 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:27.616 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-12-11T14:41:31.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:31.316 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-12-11T14:41:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:36.216 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-12-11T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-12-11T14:41:45.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:45.416 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-12-11T14:41:55.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:41:55.516 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-12-11T14:42:02.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:02.416 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-12-11T14:42:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:14.316 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-12-11T14:42:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:22.008 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2019-12-11T14:42:22.009 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-12-11T14:42:22.009 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2019-12-11T14:42:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:22.009 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 22m 55s 2019-12-11T14:42:22.009 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 5 executed 2019-12-11T14:42:22.012 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:42:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.126+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.147+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.147+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.156+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.156+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.165+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.165+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.176 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.171+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:22.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.366+0000 7f2b36bc0ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:22.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.366+0000 7f2b36bc0ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:22.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.366+0000 7f2b36bc0ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:22.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.366+0000 7f2b36bc0ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:22.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.366+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.374+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:22.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.374+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.387+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:22.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.387+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.393+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.393+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.403+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:22.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.403+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.407+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.407+0000 7f2b36bc0ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:42:22.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.407+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.411+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.411+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.419+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:22.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.419+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.425+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.425+0000 7f2b36bc0ec0 20 zonegroup default 2019-12-11T14:42:22.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.425+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.429+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.429+0000 7f2b36bc0ec0 10 Cannot find current period zone using local zone 2019-12-11T14:42:22.435 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.429+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.435+0000 7f2b36bc0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:22.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.435+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.444+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.444+0000 7f2b36bc0ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:22.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.457+0000 7f2b36bc0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:22.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.457+0000 7f2b36bc0ec0 20 zone default found 2019-12-11T14:42:22.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.457+0000 7f2b36bc0ec0 20 started sync module instance, tier type = 2019-12-11T14:42:22.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.457+0000 7f2b36bc0ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=0 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=1 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=2 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=3 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=4 2019-12-11T14:42:22.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=5 2019-12-11T14:42:22.798 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.791+0000 7f2b36bc0ec0 20 add_watcher() i=6 2019-12-11T14:42:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.822+0000 7f2b36bc0ec0 20 add_watcher() i=7 2019-12-11T14:42:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.822+0000 7f2b36bc0ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:42:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.822+0000 7f2a77fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:42:22.837 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:22.831+0000 7f2b23dea700 0 -- 172.21.15.73:0/1275994174 >> v2:172.21.15.73:3300/0 conn(0x55eeb20b2fb0 msgr2=0x55eeb20ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:42:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:23.032+0000 7f2b23dea700 0 --2- 172.21.15.73:0/1275994174 >> v2:172.21.15.73:3300/0 conn(0x55eeb20b2fb0 0x55eeb20ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T14:42:23.070 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:23.065+0000 7f2b235e9700 0 -- 172.21.15.73:0/876607271 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55eeb20cf920 msgr2=0x55eeb20d7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T14:42:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.533+0000 7f2a627fc700 20 reqs_thread_entry: start 2019-12-11T14:42:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.533+0000 7f2a5bfff700 20 reqs_thread_entry: start 2019-12-11T14:42:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.533+0000 7f2b36bc0ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:42:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.533+0000 7f2a5a7fc700 20 reqs_thread_entry: start 2019-12-11T14:42:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.534+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:42:24.589 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.577+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:24.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.596+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.604+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:24.635 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.630+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:42:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.685+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:24.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.701+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1209', time=2019-12-11T16:30:16.625187+0000, chain.objs.size()=9 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.1 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.1_1 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.2 2019-12-11T14:42:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.2_1 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.3 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.3_1 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.4 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.4_1 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~Pu_N8F2Yw5-4eJCnEBuSUCTbOzTFBXv.5 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1268', time=2019-12-11T16:33:00.142433+0000, chain.objs.size()=9 2019-12-11T14:42:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__multipart_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.1 2019-12-11T14:42:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__shadow_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.1_1 2019-12-11T14:42:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:24.721+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__multipart_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.2 2019-12-11T14:42:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__shadow_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.2_1 2019-12-11T14:42:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__multipart_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.3 2019-12-11T14:42:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__shadow_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.3_1 2019-12-11T14:42:25.212 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__multipart_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.4 2019-12-11T14:42:25.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__shadow_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.4_1 2019-12-11T14:42:25.213 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.191+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.77__multipart_key1.2~VujRvQRh0Z5bPN3gRw_vHdZXEvXo0Uy.5 2019-12-11T14:42:25.490 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.485+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:25.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.585+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:42:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.669+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.696+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.710+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:25.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.749+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:42:25.800 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.794+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:25.815 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.808+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ', time=2019-12-11T16:29:15.074327+0000, chain.objs.size()=9 2019-12-11T14:42:25.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__multipart_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.7 2019-12-11T14:42:25.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__shadow_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.7_1 2019-12-11T14:42:25.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__multipart_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.8 2019-12-11T14:42:25.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__shadow_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.8_1 2019-12-11T14:42:25.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__multipart_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.9 2019-12-11T14:42:25.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__shadow_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.9_1 2019-12-11T14:42:25.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__multipart_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.10 2019-12-11T14:42:25.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__shadow_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.10_1 2019-12-11T14:42:25.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:25.822+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.74__multipart_key1.2~UGz0tJwppIxY0GvITEQLahKno8fm5zQ.11 2019-12-11T14:42:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.034+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:26.112 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.105+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:42:26.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.152+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.170+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:26.184 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.179+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.216+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:42:26.286 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.280+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:26.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.299+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:26.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:26.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1146', time=2019-12-11T16:28:02.608678+0000, chain.objs.size()=9 2019-12-11T14:42:26.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__multipart_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.1 2019-12-11T14:42:26.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__shadow_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.1_1 2019-12-11T14:42:26.324 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__multipart_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.2 2019-12-11T14:42:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__shadow_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.2_1 2019-12-11T14:42:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__multipart_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.3 2019-12-11T14:42:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__shadow_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.3_1 2019-12-11T14:42:26.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__multipart_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.4 2019-12-11T14:42:26.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__shadow_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.4_1 2019-12-11T14:42:26.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.72__multipart_key1.2~X1KoWPIPvxGfXTsCAAwWRuxp91SP4F2.5 2019-12-11T14:42:26.586 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.579+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:26.675 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.669+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:42:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.729+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:26.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.754+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1048', time=2019-12-11T16:26:33.263511+0000, chain.objs.size()=5 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.66__shadow_.zsp5u6sReUXAGTxUG_ULnajZt2kpoL9_1 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.66__shadow_.zsp5u6sReUXAGTxUG_ULnajZt2kpoL9_2 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.66__shadow_.zsp5u6sReUXAGTxUG_ULnajZt2kpoL9_3 2019-12-11T14:42:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.66__shadow_.zsp5u6sReUXAGTxUG_ULnajZt2kpoL9_4 2019-12-11T14:42:26.782 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.775+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.66__shadow_.zsp5u6sReUXAGTxUG_ULnajZt2kpoL9_5 2019-12-11T14:42:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:26.964+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:27.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.040+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:42:27.095 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.090+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.114 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.109+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.117+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.174+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:42:27.223 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.218+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.232+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:27.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:27.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1178', time=2019-12-11T16:28:25.885065+0000, chain.objs.size()=9 2019-12-11T14:42:27.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.1 2019-12-11T14:42:27.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.1_1 2019-12-11T14:42:27.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.2 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.2_1 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.3 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.3_1 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.4 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.4_1 2019-12-11T14:42:27.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.246+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file.mpg.2~aqqkFWya1jJiTKF_bTpI1xQIjyPVMz7.5 2019-12-11T14:42:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.472+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.545+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:42:27.592 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.587+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.612 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.604+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.613+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.655+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:42:27.708 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.702+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.717+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.725+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.773+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:42:27.826 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.820+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.840+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:27.854 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.849+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:27.891 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.882+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:42:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:27.970+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:28.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.006+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:28.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.041+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:28.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.041+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1056', time=2019-12-11T16:24:05.580802+0000, chain.objs.size()=9 2019-12-11T14:42:28.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.041+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.1 2019-12-11T14:42:28.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.1_1 2019-12-11T14:42:28.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.2 2019-12-11T14:42:28.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.2_1 2019-12-11T14:42:28.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.3 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.3_1 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.4 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.4_1 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~bpMesNQkq9US86z4UqIDAUButlw4bEU.5 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1911', time=2019-12-11T16:42:15.905825+0000, chain.objs.size()=9 2019-12-11T14:42:28.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__multipart_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.1 2019-12-11T14:42:28.051 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__shadow_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.1_1 2019-12-11T14:42:28.051 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.042+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__multipart_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.2 2019-12-11T14:42:28.223 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.218+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__shadow_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.2_1 2019-12-11T14:42:28.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__multipart_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.3 2019-12-11T14:42:28.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__shadow_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.3_1 2019-12-11T14:42:28.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__multipart_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.4 2019-12-11T14:42:28.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__shadow_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.4_1 2019-12-11T14:42:28.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.317+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.119__multipart_key1/data/file.mpg.2~XkDcFFudDIPpiQhlsKcmHbJEXTNi8fB.5 2019-12-11T14:42:28.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.524+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:28.653 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.648+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:42:28.708 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.703+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.728+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:28.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:28.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1223', time=2019-12-11T16:30:56.621156+0000, chain.objs.size()=9 2019-12-11T14:42:28.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.1 2019-12-11T14:42:28.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.1_1 2019-12-11T14:42:28.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.2 2019-12-11T14:42:28.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.2_1 2019-12-11T14:42:28.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.3 2019-12-11T14:42:28.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.3_1 2019-12-11T14:42:28.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.4 2019-12-11T14:42:28.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.4_1 2019-12-11T14:42:28.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:28.745+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~3_4yEuqsgDYXioHZsyGdr30t79wIpAn.5 2019-12-11T14:42:29.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.053+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:29.152 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.147+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:42:29.206 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.201+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:29.228 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.223+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-11T14:42:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1078', time=2019-12-11T16:25:58.570056+0000, chain.objs.size()=7 2019-12-11T14:42:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.1 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.1_1 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.1_2 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.2 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.2_1 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.2_2 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~zWUFM_AI_wMMEIYVxdZIkBiWyFhHuhI.3 2019-12-11T14:42:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1127', time=2019-12-11T16:27:22.319266+0000, chain.objs.size()=9 2019-12-11T14:42:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__multipart_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.1 2019-12-11T14:42:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__shadow_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.1_1 2019-12-11T14:42:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__multipart_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.2 2019-12-11T14:42:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__shadow_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.2_1 2019-12-11T14:42:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.244+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__multipart_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.3 2019-12-11T14:42:29.564 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__shadow_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.3_1 2019-12-11T14:42:29.564 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__multipart_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.4 2019-12-11T14:42:29.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__shadow_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.4_1 2019-12-11T14:42:29.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.71__multipart_key1.2~cJ52WCjdEqMafftSfA8c8drenqS83fM.5 2019-12-11T14:42:29.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1233', time=2019-12-11T16:31:29.197216+0000, chain.objs.size()=7 2019-12-11T14:42:29.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.558+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.1 2019-12-11T14:42:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.1_1 2019-12-11T14:42:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.1_2 2019-12-11T14:42:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.2 2019-12-11T14:42:29.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.2_1 2019-12-11T14:42:29.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.2_2 2019-12-11T14:42:29.646 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:29.640+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~ofM9s-FzsXaXwQBH1d5aOAVbTfjkrgk.3 2019-12-11T14:42:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.045+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.198+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:42:30.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.260+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.293+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:30.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:30.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr', time=2019-12-11T16:20:22.087447+0000, chain.objs.size()=9 2019-12-11T14:42:30.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__multipart_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.1 2019-12-11T14:42:30.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__shadow_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.1_1 2019-12-11T14:42:30.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__multipart_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.2 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__shadow_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.2_1 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__multipart_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.3 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__shadow_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.3_1 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__multipart_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.4 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__shadow_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.4_1 2019-12-11T14:42:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.52__multipart_key1.2~KQIB7HSqQQ464No2frMn4fpqLWRuCbr.5 2019-12-11T14:42:30.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo', time=2019-12-11T16:33:17.683411+0000, chain.objs.size()=47 2019-12-11T14:42:30.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.1 2019-12-11T14:42:30.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.333+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.2 2019-12-11T14:42:30.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.334+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.3 2019-12-11T14:42:30.624 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.619+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.4 2019-12-11T14:42:30.627 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.622+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.5 2019-12-11T14:42:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.645+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.6 2019-12-11T14:42:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.645+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.7 2019-12-11T14:42:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.645+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.8 2019-12-11T14:42:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.645+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.9 2019-12-11T14:42:30.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.10 2019-12-11T14:42:30.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.11 2019-12-11T14:42:30.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.12 2019-12-11T14:42:30.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.13 2019-12-11T14:42:30.705 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.14 2019-12-11T14:42:30.705 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.698+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.15 2019-12-11T14:42:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.733+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.tiyNsnLW9m8S2rHGEI2B0be5EWYbdqS.16 2019-12-11T14:42:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.747+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.sqZVUrsiUiSakwFssQ9HlpicrMXod0t.17 2019-12-11T14:42:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.747+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.dH1bURlB180T_7YRrG9iU0rhGeo90MV.18 2019-12-11T14:42:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.747+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.PW-dI4yeuP6_Qx2PunqkrgAw23xxppz.19 2019-12-11T14:42:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.801+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.qK3yITqnqJBrHq_xz49zpBvHKD9Ik6H.20 2019-12-11T14:42:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.21 2019-12-11T14:42:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.22 2019-12-11T14:42:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.23 2019-12-11T14:42:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.24 2019-12-11T14:42:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.25 2019-12-11T14:42:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.802+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.26 2019-12-11T14:42:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.834+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.27 2019-12-11T14:42:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.875+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.28 2019-12-11T14:42:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.875+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.29 2019-12-11T14:42:30.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.899+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.30 2019-12-11T14:42:30.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.899+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.31 2019-12-11T14:42:30.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.899+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.32 2019-12-11T14:42:30.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.899+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.33 2019-12-11T14:42:30.906 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.899+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.34 2019-12-11T14:42:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.931+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.35 2019-12-11T14:42:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:30.931+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.36 2019-12-11T14:42:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.022+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.37 2019-12-11T14:42:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.028+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.38 2019-12-11T14:42:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.028+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.39 2019-12-11T14:42:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.028+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.40 2019-12-11T14:42:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.028+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.41 2019-12-11T14:42:31.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.151+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.42 2019-12-11T14:42:31.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.151+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.43 2019-12-11T14:42:31.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.151+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.44 2019-12-11T14:42:31.157 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.151+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.45 2019-12-11T14:42:31.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.152+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.46 2019-12-11T14:42:31.158 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.152+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.78__multipart_key1.2~AqXXXRoHEBGp5On-QVUbD1bRSx0VXbo.47 2019-12-11T14:42:31.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.295+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.415+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:42:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.458+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:31.480 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.475+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.483+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:31.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.526+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:42:31.597 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.591+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:31.612 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.607+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:31.620 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.615+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.655+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:42:31.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.699+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:31.719 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.714+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1064', time=2019-12-11T16:24:51.733324+0000, chain.objs.size()=9 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.1 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.1_1 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.2 2019-12-11T14:42:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.2_1 2019-12-11T14:42:31.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.3 2019-12-11T14:42:31.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.3_1 2019-12-11T14:42:31.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.4 2019-12-11T14:42:31.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.4_1 2019-12-11T14:42:31.734 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:31.727+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~P1S-eoaLtYk1V29RwloduQoE-ViO9oV.5 2019-12-11T14:42:32.154 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.149+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:32.239 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.234+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:42:32.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.277+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:32.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.296+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.964', time=2019-12-11T16:21:02.451801+0000, chain.objs.size()=2 2019-12-11T14:42:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.56__shadow_.68wcexgHb7f_SAZrdG8pepGU3abHBCW_1 2019-12-11T14:42:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.56__shadow_.68wcexgHb7f_SAZrdG8pepGU3abHBCW_2 2019-12-11T14:42:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1072', time=2019-12-11T16:25:33.094021+0000, chain.objs.size()=9 2019-12-11T14:42:32.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.1 2019-12-11T14:42:32.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.1_1 2019-12-11T14:42:32.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.309+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.2 2019-12-11T14:42:32.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.2_1 2019-12-11T14:42:32.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.3 2019-12-11T14:42:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.3_1 2019-12-11T14:42:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.4 2019-12-11T14:42:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.4_1 2019-12-11T14:42:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.310+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~gEkWgsfyodNpFjsKQ0-mmKf2x_otO1C.5 2019-12-11T14:42:32.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.733+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:32.835 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.828+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:42:32.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.875+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.890+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1084', time=2019-12-11T16:26:29.590607+0000, chain.objs.size()=7 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.1 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.1_1 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.1_2 2019-12-11T14:42:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.2 2019-12-11T14:42:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.2_1 2019-12-11T14:42:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.2_2 2019-12-11T14:42:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:32.906+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~eafv7RVqK6UhIi7u2rLyDmPuB9Lhzuh.3 2019-12-11T14:42:33.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.144+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.209+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:42:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.254+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.271+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.291+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.291+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1035', time=2019-12-11T16:22:30.426657+0000, chain.objs.size()=9 2019-12-11T14:42:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.291+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.1 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.1_1 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.2 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.2_1 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.3 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.3_1 2019-12-11T14:42:33.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.4 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.4_1 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.5 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1253', time=2019-12-11T16:32:24.954501+0000, chain.objs.size()=9 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__multipart_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.1 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__shadow_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.1_1 2019-12-11T14:42:33.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.292+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__multipart_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.2 2019-12-11T14:42:33.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.363+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__shadow_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.2_1 2019-12-11T14:42:33.406 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.400+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__multipart_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.3 2019-12-11T14:42:33.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.407+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__shadow_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.3_1 2019-12-11T14:42:33.560 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.554+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__multipart_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.4 2019-12-11T14:42:33.561 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.554+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__shadow_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.4_1 2019-12-11T14:42:33.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.562+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.76__multipart_key1.2~UjB1-pRMcEmHh1NJOLxUTcmadE4bbdu.5 2019-12-11T14:42:33.715 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.709+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:33.802 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.795+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:42:33.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.844+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:33.865 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.859+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:33.873 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.866+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.908+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:42:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:33.978+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.009+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1216', time=2019-12-11T16:30:40.813673+0000, chain.objs.size()=9 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.1 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.1_1 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.2 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.2_1 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.3 2019-12-11T14:42:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.3_1 2019-12-11T14:42:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.4 2019-12-11T14:42:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.4_1 2019-12-11T14:42:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.038+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~DifOEF98eIMwEpkqEFKNqFQXDaaM_5r.5 2019-12-11T14:42:34.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.293+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.376+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:42:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.426+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.445+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.462+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.462+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1177', time=2019-12-11T16:28:27.996954+0000, chain.objs.size()=9 2019-12-11T14:42:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.462+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.1 2019-12-11T14:42:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.462+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.1_1 2019-12-11T14:42:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.462+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.2 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.2_1 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.3 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.3_1 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.4 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__shadow_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.4_1 2019-12-11T14:42:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.73__multipart_file2.mpg.2~YT6Qqg1xmJO6JoeX1sgfC3x9uj_DDDp.5 2019-12-11T14:42:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1228', time=2019-12-11T16:31:11.812858+0000, chain.objs.size()=7 2019-12-11T14:42:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.1 2019-12-11T14:42:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.1_1 2019-12-11T14:42:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.463+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.1_2 2019-12-11T14:42:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.730+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.2 2019-12-11T14:42:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.730+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.2_1 2019-12-11T14:42:34.888 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.879+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.2_2 2019-12-11T14:42:34.888 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:34.879+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~24ScDqakPARhJTurKO4jGNtBAjpgZbm.3 2019-12-11T14:42:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.047+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:35.145 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.138+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:42:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.284+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:35.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.306+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.318+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.318+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1238', time=2019-12-11T16:31:31.998018+0000, chain.objs.size()=7 2019-12-11T14:42:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.318+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.1 2019-12-11T14:42:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.1_1 2019-12-11T14:42:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.1_2 2019-12-11T14:42:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.2 2019-12-11T14:42:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.2_1 2019-12-11T14:42:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__shadow_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.2_2 2019-12-11T14:42:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.319+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.75__multipart_key1.2~TMOnBmiHKjKff5JZaYLdsQxie6ydGb3.3 2019-12-11T14:42:35.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.749+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:35.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.893+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:42:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.941+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:35.975 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.969+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:35.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-11T14:42:35.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1033', time=2019-12-11T16:22:36.671162+0000, chain.objs.size()=9 2019-12-11T14:42:35.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.1 2019-12-11T14:42:35.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.1_1 2019-12-11T14:42:35.996 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.2 2019-12-11T14:42:35.996 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.2_1 2019-12-11T14:42:35.996 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.3 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.3_1 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.4 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__shadow_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.4_1 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.64__multipart_key1.2~c168ZfU5nO8up4jiPVI0coOBpbXB2uk.5 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1090', time=2019-12-11T16:26:39.675031+0000, chain.objs.size()=7 2019-12-11T14:42:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.1 2019-12-11T14:42:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.1_1 2019-12-11T14:42:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:35.989+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.1_2 2019-12-11T14:42:36.132 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.127+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.2 2019-12-11T14:42:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.276+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.2_1 2019-12-11T14:42:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.276+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__shadow_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.2_2 2019-12-11T14:42:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.276+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.67__multipart_key1.2~lSpdwhzkGFJvMBTfM5n5NsXnf-Wng6F.3 2019-12-11T14:42:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.477+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:36.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.558+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:42:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.597+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:36.623 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.618+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.628+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.667+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:42:36.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.750+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:36.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.781+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:36.800 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.795+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:36.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.855+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:42:36.928 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.923+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.950+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:36.962+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:37.013 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.008+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:42:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.069+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.088+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:37.101 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.096+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:37.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.150+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:42:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.203+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:37.225 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.220+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-11T14:42:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 20 garbage collection: RGWGC::process iterating over entry tag='bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4349.1895', time=2019-12-11T16:41:57.640376+0000, chain.objs.size()=9 2019-12-11T14:42:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__multipart_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.1 2019-12-11T14:42:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__shadow_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.1_1 2019-12-11T14:42:37.242 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__multipart_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.2 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__shadow_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.2_1 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__multipart_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.3 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__shadow_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.3_1 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__multipart_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.4 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__shadow_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.4_1 2019-12-11T14:42:37.243 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.236+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2.4355.118__multipart_key1.2~TqbGCDTyrydhWo7chPcQunS3-zMd9wt.5 2019-12-11T14:42:37.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.461+0000 7f2b36bc0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-11T14:42:37.628 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.623+0000 7f2b36bc0ec0 20 remove_watcher() i=0 2019-12-11T14:42:37.629 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.623+0000 7f2b36bc0ec0 2 removed watcher, disabling cache 2019-12-11T14:42:37.674 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.669+0000 7f2b36bc0ec0 20 remove_watcher() i=1 2019-12-11T14:42:37.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.711+0000 7f2b36bc0ec0 20 remove_watcher() i=2 2019-12-11T14:42:37.786 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.781+0000 7f2b36bc0ec0 20 remove_watcher() i=3 2019-12-11T14:42:37.840 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.835+0000 7f2b36bc0ec0 20 remove_watcher() i=4 2019-12-11T14:42:37.893 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.887+0000 7f2b36bc0ec0 20 remove_watcher() i=5 2019-12-11T14:42:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.941+0000 7f2b36bc0ec0 20 remove_watcher() i=6 2019-12-11T14:42:37.995 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:37.990+0000 7f2b36bc0ec0 20 remove_watcher() i=7 2019-12-11T14:42:38.003 INFO:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2019-12-11T14:42:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.096+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.124+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.124+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.131+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.131+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.136+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.136+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.143+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:38.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.297+0000 7fc2c237cec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:38.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.297+0000 7fc2c237cec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:38.302 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.297+0000 7fc2c237cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:38.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.297+0000 7fc2c237cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:38.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.297+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.304+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.304+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.323+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:38.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.324+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.331+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:38.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.331+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.342 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.337+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:38.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.338+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.344+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.344+0000 7fc2c237cec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:42:38.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.344+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.353 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.348+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.353 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.348+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.359 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.355+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:38.360 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.355+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.366+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.366+0000 7fc2c237cec0 20 zonegroup default 2019-12-11T14:42:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.366+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.375 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.370+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.370+0000 7fc2c237cec0 10 Cannot find current period zone using local zone 2019-12-11T14:42:38.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.370+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.375+0000 7fc2c237cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.375+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.386 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.382+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.382+0000 7fc2c237cec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:38.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.405+0000 7fc2c237cec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:38.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.405+0000 7fc2c237cec0 20 zone default found 2019-12-11T14:42:38.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.405+0000 7fc2c237cec0 20 started sync module instance, tier type = 2019-12-11T14:42:38.410 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.405+0000 7fc2c237cec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:42:38.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=0 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=1 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=2 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=3 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=4 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=5 2019-12-11T14:42:38.778 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.772+0000 7fc2c237cec0 20 add_watcher() i=6 2019-12-11T14:42:38.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.814+0000 7fc2c237cec0 20 add_watcher() i=7 2019-12-11T14:42:38.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.814+0000 7fc2c237cec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:42:38.819 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.814+0000 7fc27ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:42:38.832 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.827+0000 7fc2af5a6700 0 -- 172.21.15.73:0/1785556741 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f0004810 msgr2=0x7fc1f0006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:42:38.887 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:38.882+0000 7fc2aeda5700 0 -- 172.21.15.73:0/149481736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f419e29b70 msgr2=0x55f419df0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:42:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.330+0000 7fc1ee7fc700 20 reqs_thread_entry: start 2019-12-11T14:42:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.331+0000 7fc1e7fff700 20 reqs_thread_entry: start 2019-12-11T14:42:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.331+0000 7fc2c237cec0 20 init_complete bucket index max shards: 0 2019-12-11T14:42:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.331+0000 7fc1e67fc700 20 reqs_thread_entry: start 2019-12-11T14:42:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.331+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-11T14:42:40.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.378+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.401+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:40.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.409+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.455+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-11T14:42:40.499 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.494+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.517 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.512+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:40.525 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.520+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.562 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.554+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-11T14:42:40.611 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.606+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.627 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.622+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.629+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.682 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.677+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-11T14:42:40.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.755+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.784+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:40.806 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.801+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.856 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.851+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-11T14:42:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.891+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.906+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.915+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:40.948+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-11T14:42:41.013 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.008+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.034 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.029+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.040+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.095 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.086+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-11T14:42:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.130+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.153 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.148+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.157+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.199 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.194+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-11T14:42:41.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.233+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.249+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.258+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.294 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.289+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-11T14:42:41.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.404+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.438+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.451+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.502+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-11T14:42:41.554 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.549+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.567+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.576+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.617+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-11T14:42:41.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.670+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.700 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.695+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.707+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.746+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-11T14:42:41.805 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.800+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.839 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.834+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.850+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.898+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-11T14:42:41.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.947+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.966+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:41.981 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:41.975+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.018 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.013+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-11T14:42:42.075 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.070+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.091 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.086+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.100 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.095+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.146 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.141+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-11T14:42:42.222 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.217+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.265 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.259+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.275 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.270+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.346+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-11T14:42:42.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.413+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.431+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.444 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.439+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.505 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.490+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-11T14:42:42.594 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.589+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.631+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.649 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.643+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.707 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.702+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-11T14:42:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.752+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.771+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.782+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.816 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.811+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-11T14:42:42.892 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.887+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.918 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.913+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.927+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:42.979+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-11T14:42:43.032 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.027+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.047 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.042+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.055 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.050+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.121 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.116+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-11T14:42:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.158+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.178 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.173+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.187 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.181+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.363 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.358+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-11T14:42:43.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.406+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.425+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.436+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.474+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-11T14:42:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.514+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.534 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.529+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.537+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.573 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.566+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-11T14:42:43.612 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.606+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.626 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.621+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.631+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.667 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.662+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-11T14:42:43.745 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.740+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.766+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.780+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.836 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.831+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-11T14:42:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.891+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.917+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:43.939 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.934+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:43.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:43.983+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-11T14:42:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.052+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.079+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.090+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.156+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-11T14:42:44.238 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.227+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.259 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.252+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.269 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.264+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.310 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.305+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-11T14:42:44.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.371+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.393 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.388+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.401+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.442 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.436+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-11T14:42:44.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.492+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.521 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.510+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.520+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.568 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.563+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-11T14:42:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.620+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.653+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.666 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.661+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.704+0000 7fc2c237cec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-11T14:42:44.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.770+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.791 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.786+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-11T14:42:44.801 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.796+0000 7fc2c237cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-11T14:42:44.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.917+0000 7fc2c237cec0 20 remove_watcher() i=0 2019-12-11T14:42:44.922 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.917+0000 7fc2c237cec0 2 removed watcher, disabling cache 2019-12-11T14:42:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:44.976+0000 7fc2c237cec0 20 remove_watcher() i=1 2019-12-11T14:42:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.014+0000 7fc2c237cec0 20 remove_watcher() i=2 2019-12-11T14:42:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.084+0000 7fc2c237cec0 20 remove_watcher() i=3 2019-12-11T14:42:45.156 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.151+0000 7fc2c237cec0 20 remove_watcher() i=4 2019-12-11T14:42:45.200 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.195+0000 7fc2c237cec0 20 remove_watcher() i=5 2019-12-11T14:42:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.255+0000 7fc2c237cec0 20 remove_watcher() i=6 2019-12-11T14:42:45.314 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:45.310+0000 7fc2c237cec0 20 remove_watcher() i=7 2019-12-11T14:42:45.323 INFO:teuthology.run_tasks:Running task s3tests... 2019-12-11T14:42:45.338 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'public-access-qa', 'git_remote': 'git://github.com/theanalyst/'}} 2019-12-11T14:42:45.339 INFO:tasks.s3tests:Downloading s3-tests... 2019-12-11T14:42:45.339 INFO:tasks.s3tests:Using branch 'public-access-qa' for s3tests 2019-12-11T14:42:45.339 INFO:teuthology.orchestra.run.smithi073:> git clone -b public-access-qa git://github.com/theanalyst/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-12-11T14:42:45.490 INFO:teuthology.orchestra.run.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-12-11T14:42:45.863 INFO:tasks.s3tests:Creating rgw users... 2019-12-11T14:42:45.863 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-12-11T14:42:45.864 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key PGPNDFAJVZVQYZBMSUSU --secret ga8bjrr7+uu4rggrt3O54DYSm8Dkoqretfu+No9F6O80x3/JZ/elqg== --email bar.client.0+test@test.test --caps 'user-policy=*' --cluster ceph 2019-12-11T14:42:46.010 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.005+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.031 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.026+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.031 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.026+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.035+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.035+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.040+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.040+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.049+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.250+0000 7f7dd48a8ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.250+0000 7f7dd48a8ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.250+0000 7f7dd48a8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.250+0000 7f7dd48a8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.250+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.263+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.263+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.280+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.280+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.288+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.288+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.298+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.298+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.302+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.302+0000 7f7dd48a8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:42:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.302+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.308+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.308+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.315+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.315+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.325+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.325+0000 7f7dd48a8ec0 20 zonegroup default 2019-12-11T14:42:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.325+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.329+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.329+0000 7f7dd48a8ec0 10 Cannot find current period zone using local zone 2019-12-11T14:42:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.329+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.336+0000 7f7dd48a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.336+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.346+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.346+0000 7f7dd48a8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.364+0000 7f7dd48a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.364+0000 7f7dd48a8ec0 20 zone default found 2019-12-11T14:42:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.364+0000 7f7dd48a8ec0 20 started sync module instance, tier type = 2019-12-11T14:42:46.370 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.364+0000 7f7dd48a8ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:42:46.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.854+0000 7f7dd48a8ec0 20 add_watcher() i=0 2019-12-11T14:42:46.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=1 2019-12-11T14:42:46.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=2 2019-12-11T14:42:46.860 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=3 2019-12-11T14:42:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=4 2019-12-11T14:42:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=5 2019-12-11T14:42:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.855+0000 7f7dd48a8ec0 20 add_watcher() i=6 2019-12-11T14:42:46.902 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.897+0000 7f7dd48a8ec0 20 add_watcher() i=7 2019-12-11T14:42:46.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.897+0000 7f7dd48a8ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:42:46.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.897+0000 7f7d927dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:42:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.900+0000 7f7dc22d3700 0 -- 172.21.15.73:0/3188566603 >> v2:172.21.15.150:3300/0 conn(0x55fbb8791480 msgr2=0x55fbb8791890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:42:46.967 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:46.954+0000 7f7dc22d3700 0 -- 172.21.15.73:0/4136641057 >> [v2:172.21.15.73:6800/9547,v1:172.21.15.73:6801/9547] conn(0x7f7d04022480 msgr2=0x7f7d04024990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:42:48.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.306+0000 7f7d08ff9700 20 reqs_thread_entry: start 2019-12-11T14:42:48.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.306+0000 7f7cfa7fc700 20 reqs_thread_entry: start 2019-12-11T14:42:48.311 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.306+0000 7f7dd48a8ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:42:48.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.307+0000 7f7cf8ff9700 20 reqs_thread_entry: start 2019-12-11T14:42:48.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.307+0000 7f7dd48a8ec0 20 get_system_obj_state: rctx=0x7ffd61389e68 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55fbb8817950 s->prefetch_data=0 2019-12-11T14:42:48.312 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.307+0000 7f7dd48a8ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-11T14:42:48.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.318+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-11T14:42:48.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.318+0000 7f7dd48a8ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:48.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.318+0000 7f7dd48a8ec0 20 get_system_obj_state: rctx=0x7ffd61389e78 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55fbb88196e0 s->prefetch_data=0 2019-12-11T14:42:48.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.318+0000 7f7dd48a8ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-11T14:42:48.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.323+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-11T14:42:48.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.323+0000 7f7dd48a8ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T14:42:48.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.323+0000 7f7dd48a8ec0 20 get_system_obj_state: rctx=0x7ffd61389e78 obj=default.rgw.meta:users.keys:PGPNDFAJVZVQYZBMSUSU state=0x55fbb88196e0 s->prefetch_data=0 2019-12-11T14:42:48.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.323+0000 7f7dd48a8ec0 10 cache get: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU : miss 2019-12-11T14:42:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.328+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU info.flags=0x0 2019-12-11T14:42:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.328+0000 7f7dd48a8ec0 10 adding default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU to cache LRU end 2019-12-11T14:42:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.329+0000 7f7dd48a8ec0 20 get_system_obj_state: rctx=0x7ffd61389a88 obj=default.rgw.meta:users.keys:PGPNDFAJVZVQYZBMSUSU state=0x55fbb88196e0 s->prefetch_data=0 2019-12-11T14:42:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.329+0000 7f7dd48a8ec0 10 cache get: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU : type miss (requested=0x6, cached=0x0) 2019-12-11T14:42:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.334+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU info.flags=0x0 2019-12-11T14:42:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.334+0000 7f7dd48a8ec0 10 moving default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU to cache LRU end 2019-12-11T14:42:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.334+0000 7f7dd48a8ec0 20 get_system_obj_state: rctx=0x7ffd61389c08 obj=default.rgw.meta:users.keys:PGPNDFAJVZVQYZBMSUSU state=0x55fbb88196e0 s->prefetch_data=0 2019-12-11T14:42:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.334+0000 7f7dd48a8ec0 10 cache get: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU : type miss (requested=0x6, cached=0x0) 2019-12-11T14:42:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.338+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU info.flags=0x0 2019-12-11T14:42:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.338+0000 7f7dd48a8ec0 10 moving default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU to cache LRU end 2019-12-11T14:42:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.415+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T14:42:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.415+0000 7f7dd48a8ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.415+0000 7f7dd48a8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-12-11T14:42:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.426+0000 7f7da2ffd700 10 RGWWatcher::handle_notify() notify_id 554050781220 cookie 94539620004080 notifier 4592 bl.length()=636 2019-12-11T14:42:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.427+0000 7f7da2ffd700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T14:42:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.427+0000 7f7da2ffd700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:48.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.666+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-11T14:42:48.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.666+0000 7f7dd48a8ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T14:42:48.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.666+0000 7f7dd48a8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-11T14:42:48.679 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.674+0000 7f7da2ffd700 10 RGWWatcher::handle_notify() notify_id 554050781221 cookie 94539620004080 notifier 4592 bl.length()=194 2019-12-11T14:42:48.679 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.674+0000 7f7da2ffd700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-11T14:42:48.680 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:48.674+0000 7f7da2ffd700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T14:42:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.181+0000 7f7dd48a8ec0 10 cache put: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU info.flags=0x7 2019-12-11T14:42:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.181+0000 7f7dd48a8ec0 10 moving default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU to cache LRU end 2019-12-11T14:42:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.181+0000 7f7dd48a8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=186 2019-12-11T14:42:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.200+0000 7f7da2ffd700 10 RGWWatcher::handle_notify() notify_id 554050781218 cookie 94539620007312 notifier 4592 bl.length()=186 2019-12-11T14:42:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.200+0000 7f7da2ffd700 10 cache put: name=default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU info.flags=0x7 2019-12-11T14:42:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.200+0000 7f7da2ffd700 10 moving default.rgw.meta+users.keys+PGPNDFAJVZVQYZBMSUSU to cache LRU end 2019-12-11T14:42:49.514 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T14:42:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "bar.client.0", 2019-12-11T14:42:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. bar.client.0", 2019-12-11T14:42:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "bar.client.0+test@test.test", 2019-12-11T14:42:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T14:42:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T14:42:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T14:42:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T14:42:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:42:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "bar.client.0", 2019-12-11T14:42:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "PGPNDFAJVZVQYZBMSUSU", 2019-12-11T14:42:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "ga8bjrr7+uu4rggrt3O54DYSm8Dkoqretfu+No9F6O80x3/JZ/elqg==" 2019-12-11T14:42:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [ 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "user-policy", 2019-12-11T14:42:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2019-12-11T14:42:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:42:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:42:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T14:42:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T14:42:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:42:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:42:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T14:42:49.521 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T14:42:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.560+0000 7f7dd48a8ec0 20 remove_watcher() i=0 2019-12-11T14:42:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.560+0000 7f7dd48a8ec0 2 removed watcher, disabling cache 2019-12-11T14:42:49.599 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.594+0000 7f7dd48a8ec0 20 remove_watcher() i=1 2019-12-11T14:42:49.631 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.626+0000 7f7dd48a8ec0 20 remove_watcher() i=2 2019-12-11T14:42:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.699+0000 7f7dd48a8ec0 20 remove_watcher() i=3 2019-12-11T14:42:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.751+0000 7f7dd48a8ec0 20 remove_watcher() i=4 2019-12-11T14:42:49.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.783+0000 7f7dd48a8ec0 20 remove_watcher() i=5 2019-12-11T14:42:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.849+0000 7f7dd48a8ec0 20 remove_watcher() i=6 2019-12-11T14:42:49.917 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:49.912+0000 7f7dd48a8ec0 20 remove_watcher() i=7 2019-12-11T14:42:49.928 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 8102806907 --totp-seed IPRTY75QOVPM4XAK5YQNTVKXK6DOQ262FBSFFOMD4C67FGPE37OHSS2DNA5UGTXG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-11T14:42:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.096+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.122+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.122+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.132+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.132+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.138+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.138+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.146+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.325+0000 7f9cffef8ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.325+0000 7f9cffef8ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.325+0000 7f9cffef8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.325+0000 7f9cffef8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.325+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.334+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.334+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.353+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:50.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.353+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.362+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:50.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.362+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.373+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:50.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.374+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.379+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.379+0000 7f9cffef8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:42:50.384 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.379+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.390 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.385+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.385+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.400 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.395+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:50.401 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.395+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.403+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:50.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.403+0000 7f9cffef8ec0 20 zonegroup default 2019-12-11T14:42:50.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.403+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.407+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.407+0000 7f9cffef8ec0 10 Cannot find current period zone using local zone 2019-12-11T14:42:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.407+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.413+0000 7f9cffef8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.413+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.421+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.421+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.435+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.435+0000 7f9cffef8ec0 20 zone default found 2019-12-11T14:42:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.435+0000 7f9cffef8ec0 20 started sync module instance, tier type = 2019-12-11T14:42:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.435+0000 7f9cffef8ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=0 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=1 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=2 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=3 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=4 2019-12-11T14:42:50.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=5 2019-12-11T14:42:50.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.748+0000 7f9cffef8ec0 20 add_watcher() i=6 2019-12-11T14:42:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.782+0000 7f9cffef8ec0 20 add_watcher() i=7 2019-12-11T14:42:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.782+0000 7f9cffef8ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:42:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.782+0000 7f9cbdfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:42:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.789+0000 7f9ced923700 0 -- 172.21.15.73:0/3005614412 >> v2:172.21.15.73:3300/0 conn(0x55611ec34800 msgr2=0x55611ec34c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:42:50.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:50.833+0000 7f9ced923700 0 -- 172.21.15.73:0/275850227 >> [v2:172.21.15.73:6800/9547,v1:172.21.15.73:6801/9547] conn(0x7f9c300224d0 msgr2=0x7f9c300249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T14:42:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.159+0000 7f9c2ffff700 20 reqs_thread_entry: start 2019-12-11T14:42:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.159+0000 7f9c2dffb700 20 reqs_thread_entry: start 2019-12-11T14:42:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.159+0000 7f9cffef8ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:42:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.160+0000 7f9c1bfff700 20 reqs_thread_entry: start 2019-12-11T14:42:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.160+0000 7f9cffef8ec0 20 get_system_obj_state: rctx=0x7ffca5419518 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55611ecbac30 s->prefetch_data=0 2019-12-11T14:42:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.160+0000 7f9cffef8ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-11T14:42:52.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-11T14:42:52.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:52.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T14:42:52.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T14:42:52.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T14:42:52.189 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.183+0000 7f9cffef8ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:52.217 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.213+0000 7f9cffef8ec0 20 rados_obj.operate() r=0 bl.length=451 2019-12-11T14:42:52.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.213+0000 7f9cffef8ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-11T14:42:52.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:52.213+0000 7f9cffef8ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.166+0000 7f9cffef8ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T14:42:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.166+0000 7f9cffef8ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.166+0000 7f9cffef8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=650 2019-12-11T14:42:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.174+0000 7f9cce7fc700 10 RGWWatcher::handle_notify() notify_id 562640715814 cookie 93875616204928 notifier 4604 bl.length()=650 2019-12-11T14:42:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.174+0000 7f9cce7fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T14:42:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.174+0000 7f9cce7fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T14:42:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.527+0000 7f9cffef8ec0 20 remove_watcher() i=0 2019-12-11T14:42:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.527+0000 7f9cffef8ec0 2 removed watcher, disabling cache 2019-12-11T14:42:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.579+0000 7f9cffef8ec0 20 remove_watcher() i=1 2019-12-11T14:42:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.616+0000 7f9cffef8ec0 20 remove_watcher() i=2 2019-12-11T14:42:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.658+0000 7f9cffef8ec0 20 remove_watcher() i=3 2019-12-11T14:42:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.706+0000 7f9cffef8ec0 20 remove_watcher() i=4 2019-12-11T14:42:54.760 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.755+0000 7f9cffef8ec0 20 remove_watcher() i=5 2019-12-11T14:42:54.962 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:54.957+0000 7f9cffef8ec0 20 remove_watcher() i=6 2019-12-11T14:42:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.067+0000 7f9cffef8ec0 20 remove_watcher() i=7 2019-12-11T14:42:55.080 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-12-11T14:42:55.080 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key IPEFVTOIYNACNNPHUSTO --secret voe6JvWeRlBfzGbiCHDmbWA9irgCu66dI/geejWbl3R2B5NoZfdKoA== --email foo.client.0+test@test.test --caps 'user-policy=*' --cluster ceph 2019-12-11T14:42:55.204 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.199+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:55.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.420+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:55.425 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.420+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.429+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.429+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.441+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:55.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.441+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:55.455 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:55.450+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.025+0000 7fa980703ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.025+0000 7fa980703ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.025+0000 7fa980703ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.025+0000 7fa980703ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.025+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.035+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.035+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.053+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.053+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.062+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.062+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.072+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.072+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.083+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.083+0000 7fa980703ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:42:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.083+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.088+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.088+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.097+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.097+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.108+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:42:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.108+0000 7fa980703ec0 20 zonegroup default 2019-12-11T14:42:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.108+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.126+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.126+0000 7fa980703ec0 10 Cannot find current period zone using local zone 2019-12-11T14:42:56.132 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.126+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.142+0000 7fa980703ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.142+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.155+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.155+0000 7fa980703ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.167+0000 7fa980703ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.167+0000 7fa980703ec0 20 zone default found 2019-12-11T14:42:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.167+0000 7fa980703ec0 20 started sync module instance, tier type = 2019-12-11T14:42:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.167+0000 7fa980703ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:42:56.604 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa96d92d700 0 -- 172.21.15.73:0/807764750 >> [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] conn(0x559d91598d20 msgr2=0x559d9159b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:42:56.604 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=0 2019-12-11T14:42:56.604 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=1 2019-12-11T14:42:56.605 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=2 2019-12-11T14:42:56.605 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=3 2019-12-11T14:42:56.605 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=4 2019-12-11T14:42:56.605 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=5 2019-12-11T14:42:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.598+0000 7fa980703ec0 20 add_watcher() i=6 2019-12-11T14:42:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.663+0000 7fa980703ec0 20 add_watcher() i=7 2019-12-11T14:42:56.669 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.663+0000 7fa980703ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:42:56.669 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.663+0000 7fa93e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:42:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:56.683+0000 7fa96d12c700 0 -- 172.21.15.73:0/461540321 >> v2:172.21.15.73:3300/0 conn(0x559d915b1370 msgr2=0x559d915b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:42:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.006+0000 7fa8b4ff9700 20 reqs_thread_entry: start 2019-12-11T14:42:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.007+0000 7fa8ae7fc700 20 reqs_thread_entry: start 2019-12-11T14:42:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.007+0000 7fa980703ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:42:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.007+0000 7fa8acff9700 20 reqs_thread_entry: start 2019-12-11T14:42:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.007+0000 7fa980703ec0 20 get_system_obj_state: rctx=0x7ffe5a700168 obj=default.rgw.meta:users.uid:foo.client.0 state=0x559d91628e80 s->prefetch_data=0 2019-12-11T14:42:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.007+0000 7fa980703ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-11T14:42:58.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.023+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-11T14:42:58.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.023+0000 7fa980703ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:42:58.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.023+0000 7fa980703ec0 20 get_system_obj_state: rctx=0x7ffe5a700178 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x559d9162ac10 s->prefetch_data=0 2019-12-11T14:42:58.028 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.023+0000 7fa980703ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-11T14:42:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.030+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-11T14:42:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.030+0000 7fa980703ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T14:42:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.030+0000 7fa980703ec0 20 get_system_obj_state: rctx=0x7ffe5a700178 obj=default.rgw.meta:users.keys:IPEFVTOIYNACNNPHUSTO state=0x559d9162ac10 s->prefetch_data=0 2019-12-11T14:42:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.030+0000 7fa980703ec0 10 cache get: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO : miss 2019-12-11T14:42:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.037+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO info.flags=0x0 2019-12-11T14:42:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.037+0000 7fa980703ec0 10 adding default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO to cache LRU end 2019-12-11T14:42:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.037+0000 7fa980703ec0 20 get_system_obj_state: rctx=0x7ffe5a6ffd88 obj=default.rgw.meta:users.keys:IPEFVTOIYNACNNPHUSTO state=0x559d9162ac10 s->prefetch_data=0 2019-12-11T14:42:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.037+0000 7fa980703ec0 10 cache get: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO : type miss (requested=0x6, cached=0x0) 2019-12-11T14:42:58.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.044+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO info.flags=0x0 2019-12-11T14:42:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.044+0000 7fa980703ec0 10 moving default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO to cache LRU end 2019-12-11T14:42:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.044+0000 7fa980703ec0 20 get_system_obj_state: rctx=0x7ffe5a6fff08 obj=default.rgw.meta:users.keys:IPEFVTOIYNACNNPHUSTO state=0x559d9162ac10 s->prefetch_data=0 2019-12-11T14:42:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.044+0000 7fa980703ec0 10 cache get: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO : type miss (requested=0x6, cached=0x0) 2019-12-11T14:42:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.051+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO info.flags=0x0 2019-12-11T14:42:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.051+0000 7fa980703ec0 10 moving default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO to cache LRU end 2019-12-11T14:42:58.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.118+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T14:42:58.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.118+0000 7fa980703ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:42:58.123 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.118+0000 7fa980703ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-12-11T14:42:58.140 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.135+0000 7fa94effd700 10 RGWWatcher::handle_notify() notify_id 566935683097 cookie 94135236746224 notifier 4971 bl.length()=636 2019-12-11T14:42:58.140 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.135+0000 7fa94effd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T14:42:58.141 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.135+0000 7fa94effd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:42:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.277+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-11T14:42:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.277+0000 7fa980703ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T14:42:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.277+0000 7fa980703ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-11T14:42:58.300 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.295+0000 7fa94effd700 10 RGWWatcher::handle_notify() notify_id 566935683130 cookie 94135236789104 notifier 4971 bl.length()=194 2019-12-11T14:42:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.295+0000 7fa94effd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-11T14:42:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.295+0000 7fa94effd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T14:42:58.658 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.653+0000 7fa980703ec0 10 cache put: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO info.flags=0x7 2019-12-11T14:42:58.658 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.653+0000 7fa980703ec0 10 moving default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO to cache LRU end 2019-12-11T14:42:58.659 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.653+0000 7fa980703ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=186 2019-12-11T14:42:58.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.667+0000 7fa94effd700 10 RGWWatcher::handle_notify() notify_id 566935683107 cookie 94135236756960 notifier 4971 bl.length()=186 2019-12-11T14:42:58.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.667+0000 7fa94effd700 10 cache put: name=default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO info.flags=0x7 2019-12-11T14:42:58.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:58.667+0000 7fa94effd700 10 moving default.rgw.meta+users.keys+IPEFVTOIYNACNNPHUSTO to cache LRU end 2019-12-11T14:42:59.021 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T14:42:59.021 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "foo.client.0", 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. foo.client.0", 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "foo.client.0+test@test.test", 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T14:42:59.022 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T14:42:59.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:42:59.023 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "foo.client.0", 2019-12-11T14:42:59.023 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "IPEFVTOIYNACNNPHUSTO", 2019-12-11T14:42:59.023 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "voe6JvWeRlBfzGbiCHDmbWA9irgCu66dI/geejWbl3R2B5NoZfdKoA==" 2019-12-11T14:42:59.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [ 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "user-policy", 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2019-12-11T14:42:59.024 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T14:42:59.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T14:42:59.026 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T14:42:59.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T14:42:59.028 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T14:42:59.028 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T14:42:59.028 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:42:59.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.084+0000 7fa980703ec0 20 remove_watcher() i=0 2019-12-11T14:42:59.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.084+0000 7fa980703ec0 2 removed watcher, disabling cache 2019-12-11T14:42:59.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.138+0000 7fa980703ec0 20 remove_watcher() i=1 2019-12-11T14:42:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.173+0000 7fa980703ec0 20 remove_watcher() i=2 2019-12-11T14:42:59.253 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.248+0000 7fa980703ec0 20 remove_watcher() i=3 2019-12-11T14:42:59.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.304+0000 7fa980703ec0 20 remove_watcher() i=4 2019-12-11T14:42:59.358 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.353+0000 7fa980703ec0 20 remove_watcher() i=5 2019-12-11T14:42:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.413+0000 7fa980703ec0 20 remove_watcher() i=6 2019-12-11T14:42:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.457+0000 7fa980703ec0 20 remove_watcher() i=7 2019-12-11T14:42:59.473 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 4160797066 --totp-seed YTLDA73HBTQ65OUGY3FYTKMDCWLEMHJEZEMLOPLVNGEU5QCO434XVUN7LTG6SI4G --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-11T14:42:59.656 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.651+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.699+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:59.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.699+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.707+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:59.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.707+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.713+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:42:59.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.713+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.720+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:59.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.965+0000 7f7b88533ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:42:59.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.965+0000 7f7b88533ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:42:59.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.965+0000 7f7b88533ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:42:59.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.965+0000 7f7b88533ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:42:59.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.965+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.979 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.974+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:42:59.979 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.974+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:42:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.992+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:42:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:42:59.992+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.002+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.002+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.010+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.010+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.015+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:00.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.016+0000 7f7b88533ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:43:00.021 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.016+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.021+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.021+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.030+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.030+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.038+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.038+0000 7f7b88533ec0 20 zonegroup default 2019-12-11T14:43:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.038+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.044+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.044+0000 7f7b88533ec0 10 Cannot find current period zone using local zone 2019-12-11T14:43:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.044+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.049+0000 7f7b88533ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:00.054 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.049+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.056+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.056+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:00.078 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.073+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:43:00.078 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.073+0000 7f7b88533ec0 20 zone default found 2019-12-11T14:43:00.078 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.073+0000 7f7b88533ec0 20 started sync module instance, tier type = 2019-12-11T14:43:00.078 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.073+0000 7f7b88533ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:43:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=0 2019-12-11T14:43:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=1 2019-12-11T14:43:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=2 2019-12-11T14:43:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=3 2019-12-11T14:43:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=4 2019-12-11T14:43:00.498 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.492+0000 7f7b88533ec0 20 add_watcher() i=5 2019-12-11T14:43:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.501+0000 7f7b88533ec0 20 add_watcher() i=6 2019-12-11T14:43:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.534+0000 7f7b88533ec0 20 add_watcher() i=7 2019-12-11T14:43:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.534+0000 7f7b88533ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:43:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.534+0000 7f7b45fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:43:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.537+0000 7f7b74f5c700 0 -- 172.21.15.73:0/2754304013 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x560539a13f30 msgr2=0x560539a16440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:43:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.565+0000 7f7b75f5e700 0 -- 172.21.15.73:0/1930849841 >> v2:172.21.15.150:3300/0 conn(0x560539a10af0 msgr2=0x560539a10f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T14:43:00.773 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:00.768+0000 7f7b75f5e700 0 --2- 172.21.15.73:0/1930849841 >> v2:172.21.15.150:3300/0 conn(0x560539a10af0 0x560539a10f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-11T14:43:02.379 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.374+0000 7f7ab7fff700 20 reqs_thread_entry: start 2019-12-11T14:43:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.374+0000 7f7ab5ffb700 20 reqs_thread_entry: start 2019-12-11T14:43:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.374+0000 7f7b88533ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:43:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.375+0000 7f7aa3fff700 20 reqs_thread_entry: start 2019-12-11T14:43:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.375+0000 7f7b88533ec0 20 get_system_obj_state: rctx=0x7ffc0b00b588 obj=default.rgw.meta:users.uid:foo.client.0 state=0x560539a90950 s->prefetch_data=0 2019-12-11T14:43:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.375+0000 7f7b88533ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-11T14:43:02.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-11T14:43:02.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:43:02.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T14:43:02.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T14:43:02.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T14:43:02.397 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.391+0000 7f7b88533ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:02.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.410+0000 7f7b88533ec0 20 rados_obj.operate() r=0 bl.length=451 2019-12-11T14:43:02.415 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.410+0000 7f7b88533ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-11T14:43:02.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.410+0000 7f7b88533ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:43:02.533 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.528+0000 7f7b88533ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T14:43:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.528+0000 7f7b88533ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:43:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.528+0000 7f7b88533ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=650 2019-12-11T14:43:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.542+0000 7f7b567fc700 10 RGWWatcher::handle_notify() notify_id 566935683098 cookie 94580441566288 notifier 4619 bl.length()=650 2019-12-11T14:43:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.542+0000 7f7b567fc700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T14:43:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.542+0000 7f7b567fc700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T14:43:02.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.699+0000 7f7b88533ec0 20 remove_watcher() i=0 2019-12-11T14:43:02.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.699+0000 7f7b88533ec0 2 removed watcher, disabling cache 2019-12-11T14:43:02.753 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.748+0000 7f7b88533ec0 20 remove_watcher() i=1 2019-12-11T14:43:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.792+0000 7f7b88533ec0 20 remove_watcher() i=2 2019-12-11T14:43:02.874 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.869+0000 7f7b88533ec0 20 remove_watcher() i=3 2019-12-11T14:43:02.916 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.911+0000 7f7b88533ec0 20 remove_watcher() i=4 2019-12-11T14:43:02.980 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:02.974+0000 7f7b88533ec0 20 remove_watcher() i=5 2019-12-11T14:43:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.026+0000 7f7b88533ec0 20 remove_watcher() i=6 2019-12-11T14:43:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.088+0000 7f7b88533ec0 20 remove_watcher() i=7 2019-12-11T14:43:03.101 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-12-11T14:43:03.102 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key WSKDJRCTJGDGQCDHEYQK --secret 53IGQ+gf6Zv9iMUSr78Vr590foIkAwPKbb6qipytQsT9JyDfp2Dpzw== --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --cluster ceph 2019-12-11T14:43:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.220+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.242+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.242+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.251+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.251+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.255+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.255+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.261+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:03.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.457+0000 7f9966038ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:43:03.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.457+0000 7f9966038ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:43:03.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.457+0000 7f9966038ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:43:03.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.457+0000 7f9966038ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:43:03.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.457+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.468+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:03.474 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.468+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.483+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:43:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.483+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.508 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.503+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:03.508 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.503+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.518 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.513+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:03.519 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.513+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.519+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.519+0000 7f9966038ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:43:03.526 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.519+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.526+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.531 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.526+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.536+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.536+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.546+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.546+0000 7f9966038ec0 20 zonegroup default 2019-12-11T14:43:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.546+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.553+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.553+0000 7f9966038ec0 10 Cannot find current period zone using local zone 2019-12-11T14:43:03.558 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.553+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.558+0000 7f9966038ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:03.563 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.558+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.571 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.566+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:03.571 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.566+0000 7f9966038ec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:03.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.582+0000 7f9966038ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:43:03.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.583+0000 7f9966038ec0 20 zone default found 2019-12-11T14:43:03.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.583+0000 7f9966038ec0 20 started sync module instance, tier type = 2019-12-11T14:43:03.588 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:03.583+0000 7f9966038ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:43:04.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=0 2019-12-11T14:43:04.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=1 2019-12-11T14:43:04.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=2 2019-12-11T14:43:04.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=3 2019-12-11T14:43:04.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=4 2019-12-11T14:43:04.041 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.035+0000 7f9966038ec0 20 add_watcher() i=5 2019-12-11T14:43:04.066 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.061+0000 7f9966038ec0 20 add_watcher() i=6 2019-12-11T14:43:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.072+0000 7f9966038ec0 20 add_watcher() i=7 2019-12-11T14:43:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.072+0000 7f9966038ec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:43:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.072+0000 7f9923fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:43:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.076+0000 7f994bfff700 0 -- 172.21.15.73:0/3162944316 >> v2:172.21.15.73:3300/0 conn(0x5580a11c3730 msgr2=0x5580a11c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:43:04.125 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:04.120+0000 7f994bfff700 0 -- 172.21.15.73:0/2420728960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9894002860 msgr2=0x7f9894002d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:43:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.561+0000 7f98927fc700 20 reqs_thread_entry: start 2019-12-11T14:43:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.562+0000 7f988bfff700 20 reqs_thread_entry: start 2019-12-11T14:43:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.562+0000 7f9966038ec0 20 init_complete bucket index max shards: 0 2019-12-11T14:43:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.562+0000 7f988a7fc700 20 reqs_thread_entry: start 2019-12-11T14:43:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.562+0000 7f9966038ec0 20 get_system_obj_state: rctx=0x7fff7b2b19e8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5580a1239210 s->prefetch_data=0 2019-12-11T14:43:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.562+0000 7f9966038ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-11T14:43:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.567+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-12-11T14:43:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.567+0000 7f9966038ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.567+0000 7f9966038ec0 20 get_system_obj_state: rctx=0x7fff7b2b19f8 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x5580a123afc0 s->prefetch_data=0 2019-12-11T14:43:05.573 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.567+0000 7f9966038ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-12-11T14:43:05.578 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.572+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-12-11T14:43:05.578 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.572+0000 7f9966038ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-11T14:43:05.578 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.572+0000 7f9966038ec0 20 get_system_obj_state: rctx=0x7fff7b2b19f8 obj=default.rgw.meta:users.keys:WSKDJRCTJGDGQCDHEYQK state=0x5580a123afc0 s->prefetch_data=0 2019-12-11T14:43:05.578 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.572+0000 7f9966038ec0 10 cache get: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK : miss 2019-12-11T14:43:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.585+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK info.flags=0x0 2019-12-11T14:43:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.585+0000 7f9966038ec0 10 adding default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK to cache LRU end 2019-12-11T14:43:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.585+0000 7f9966038ec0 20 get_system_obj_state: rctx=0x7fff7b2b1608 obj=default.rgw.meta:users.keys:WSKDJRCTJGDGQCDHEYQK state=0x5580a123afc0 s->prefetch_data=0 2019-12-11T14:43:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.585+0000 7f9966038ec0 10 cache get: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK : type miss (requested=0x6, cached=0x0) 2019-12-11T14:43:05.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.596+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK info.flags=0x0 2019-12-11T14:43:05.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.596+0000 7f9966038ec0 10 moving default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK to cache LRU end 2019-12-11T14:43:05.601 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.596+0000 7f9966038ec0 20 get_system_obj_state: rctx=0x7fff7b2b1788 obj=default.rgw.meta:users.keys:WSKDJRCTJGDGQCDHEYQK state=0x5580a123afc0 s->prefetch_data=0 2019-12-11T14:43:05.602 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.596+0000 7f9966038ec0 10 cache get: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK : type miss (requested=0x6, cached=0x0) 2019-12-11T14:43:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.609+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK info.flags=0x0 2019-12-11T14:43:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.609+0000 7f9966038ec0 10 moving default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK to cache LRU end 2019-12-11T14:43:05.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.659+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-11T14:43:05.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.659+0000 7f9966038ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:05.664 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.659+0000 7f9966038ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=710 2019-12-11T14:43:05.672 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.667+0000 7f9948ff9700 10 RGWWatcher::handle_notify() notify_id 566935683144 cookie 94010947063376 notifier 5007 bl.length()=710 2019-12-11T14:43:05.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.667+0000 7f9948ff9700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-11T14:43:05.673 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.667+0000 7f9948ff9700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:05.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.983+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-11T14:43:05.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.983+0000 7f9966038ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-11T14:43:05.988 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:05.983+0000 7f9966038ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-12-11T14:43:06.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.006+0000 7f9948ff9700 10 RGWWatcher::handle_notify() notify_id 566935683131 cookie 94010947081456 notifier 5007 bl.length()=224 2019-12-11T14:43:06.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.006+0000 7f9948ff9700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-11T14:43:06.011 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.006+0000 7f9948ff9700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-11T14:43:06.307 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.302+0000 7f9966038ec0 10 cache put: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK info.flags=0x7 2019-12-11T14:43:06.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.302+0000 7f9966038ec0 10 moving default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK to cache LRU end 2019-12-11T14:43:06.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.302+0000 7f9966038ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=201 2019-12-11T14:43:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.317+0000 7f9948ff9700 10 RGWWatcher::handle_notify() notify_id 566935683105 cookie 94010947061584 notifier 5007 bl.length()=201 2019-12-11T14:43:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.317+0000 7f9948ff9700 10 cache put: name=default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK info.flags=0x7 2019-12-11T14:43:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:06.317+0000 7f9948ff9700 10 moving default.rgw.meta+users.keys+WSKDJRCTJGDGQCDHEYQK to cache LRU end 2019-12-11T14:43:06.978 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T14:43:06.978 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "testx$tenanteduser.client.0", 2019-12-11T14:43:06.978 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-12-11T14:43:06.978 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-12-11T14:43:06.978 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "testx$tenanteduser.client.0", 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "WSKDJRCTJGDGQCDHEYQK", 2019-12-11T14:43:06.979 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "53IGQ+gf6Zv9iMUSr78Vr590foIkAwPKbb6qipytQsT9JyDfp2Dpzw==" 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [ 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "user-policy", 2019-12-11T14:43:06.980 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T14:43:06.981 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T14:43:06.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:43:06.982 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:43:06.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:43:06.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:43:06.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T14:43:06.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T14:43:06.984 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T14:43:06.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T14:43:06.984 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T14:43:06.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T14:43:06.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T14:43:06.985 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T14:43:06.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:07.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.043+0000 7f9966038ec0 20 remove_watcher() i=0 2019-12-11T14:43:07.049 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.043+0000 7f9966038ec0 2 removed watcher, disabling cache 2019-12-11T14:43:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.097+0000 7f9966038ec0 20 remove_watcher() i=1 2019-12-11T14:43:07.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.158+0000 7f9966038ec0 20 remove_watcher() i=2 2019-12-11T14:43:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.213+0000 7f9966038ec0 20 remove_watcher() i=3 2019-12-11T14:43:07.256 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.250+0000 7f9966038ec0 20 remove_watcher() i=4 2019-12-11T14:43:07.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.294+0000 7f9966038ec0 20 remove_watcher() i=5 2019-12-11T14:43:07.351 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.345+0000 7f9966038ec0 20 remove_watcher() i=6 2019-12-11T14:43:07.408 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.403+0000 7f9966038ec0 20 remove_watcher() i=7 2019-12-11T14:43:07.420 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3992161794 --totp-seed 4ZPY2MSDADNQJK6UCVAN3VKUAK4CHKICYYPM5674BEC427JMU2PKGDJMSWDWGM3O --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-11T14:43:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.595+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.622 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.617+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.623 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.617+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.630 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.625+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.631 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.625+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.630+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.636 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.630+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.643 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.638+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.832+0000 7f08240edec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T14:43:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.832+0000 7f08240edec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T14:43:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.832+0000 7f08240edec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T14:43:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.832+0000 7f08240edec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T14:43:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.832+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.848 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.843+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:07.848 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.843+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.864+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:43:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.864+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.880 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.875+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:07.881 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.875+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.901+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.901+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.912 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.907+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.907+0000 7f08240edec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T14:43:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.907+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.918 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.912+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.919 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.912+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.921+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.921+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.928+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T14:43:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.929+0000 7f08240edec0 20 zonegroup default 2019-12-11T14:43:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.929+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.934+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.934+0000 7f08240edec0 10 Cannot find current period zone using local zone 2019-12-11T14:43:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.934+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.938+0000 7f08240edec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T14:43:07.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.938+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.947+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T14:43:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.947+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.962+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T14:43:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.962+0000 7f08240edec0 20 zone default found 2019-12-11T14:43:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.962+0000 7f08240edec0 20 started sync module instance, tier type = 2019-12-11T14:43:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:07.962+0000 7f08240edec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T14:43:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=0 2019-12-11T14:43:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=1 2019-12-11T14:43:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=2 2019-12-11T14:43:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=3 2019-12-11T14:43:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=4 2019-12-11T14:43:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=5 2019-12-11T14:43:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.408+0000 7f08240edec0 20 add_watcher() i=6 2019-12-11T14:43:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.446+0000 7f08240edec0 20 add_watcher() i=7 2019-12-11T14:43:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.446+0000 7f08240edec0 2 all 8 watchers are set, enabling cache 2019-12-11T14:43:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.446+0000 7f07e1fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T14:43:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.450+0000 7f0810b16700 0 -- 172.21.15.73:0/3346569900 >> v2:172.21.15.73:3300/0 conn(0x557014457d80 msgr2=0x55701445a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T14:43:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:08.503+0000 7f0810b16700 0 -- 172.21.15.73:0/8736394 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x557014468f40 msgr2=0x55701446b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T14:43:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.322+0000 7f0753fff700 20 reqs_thread_entry: start 2019-12-11T14:43:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.322+0000 7f0751ffb700 20 reqs_thread_entry: start 2019-12-11T14:43:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.322+0000 7f08240edec0 20 init_complete bucket index max shards: 0 2019-12-11T14:43:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.323+0000 7f073ffff700 20 reqs_thread_entry: start 2019-12-11T14:43:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.323+0000 7f08240edec0 20 get_system_obj_state: rctx=0x7ffcff65d0d8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5570144d59a0 s->prefetch_data=0 2019-12-11T14:43:10.329 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.323+0000 7f08240edec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-11T14:43:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-11T14:43:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T14:43:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T14:43:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T14:43:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.332+0000 7f08240edec0 20 rados->read ofs=0 len=0 2019-12-11T14:43:10.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.343+0000 7f08240edec0 20 rados_obj.operate() r=0 bl.length=510 2019-12-11T14:43:10.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.344+0000 7f08240edec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-11T14:43:10.349 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.344+0000 7f08240edec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.489+0000 7f08240edec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-11T14:43:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.489+0000 7f08240edec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.489+0000 7f08240edec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=724 2019-12-11T14:43:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.496+0000 7f07f27fc700 10 RGWWatcher::handle_notify() notify_id 566935683145 cookie 93939864695232 notifier 5028 bl.length()=724 2019-12-11T14:43:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.496+0000 7f07f27fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-11T14:43:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.496+0000 7f07f27fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T14:43:10.688 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.683+0000 7f08240edec0 20 remove_watcher() i=0 2019-12-11T14:43:10.689 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.683+0000 7f08240edec0 2 removed watcher, disabling cache 2019-12-11T14:43:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.721+0000 7f08240edec0 20 remove_watcher() i=1 2019-12-11T14:43:10.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.754+0000 7f08240edec0 20 remove_watcher() i=2 2019-12-11T14:43:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.811+0000 7f08240edec0 20 remove_watcher() i=3 2019-12-11T14:43:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.861+0000 7f08240edec0 20 remove_watcher() i=4 2019-12-11T14:43:10.920 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.915+0000 7f08240edec0 20 remove_watcher() i=5 2019-12-11T14:43:10.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:10.978+0000 7f08240edec0 20 remove_watcher() i=6 2019-12-11T14:43:11.048 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T14:43:11.042+0000 7f08240edec0 20 remove_watcher() i=7 2019-12-11T14:43:11.053 INFO:tasks.s3tests:Configuring s3-tests... 2019-12-11T14:43:11.053 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-12-11T14:43:16.792 INFO:teuthology.orchestra.run.smithi073.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-11T14:43:16.907 INFO:teuthology.orchestra.run.smithi073.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-11T14:43:16.945 INFO:teuthology.orchestra.run.smithi073.stdout:Loading mirror speeds from cached hostfile 2019-12-11T14:43:16.946 INFO:teuthology.orchestra.run.smithi073.stdout: * base: mirror.linux.duke.edu 2019-12-11T14:43:16.946 INFO:teuthology.orchestra.run.smithi073.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-11T14:43:16.947 INFO:teuthology.orchestra.run.smithi073.stdout: * extras: mirror.atlanticmetro.net 2019-12-11T14:43:16.947 INFO:teuthology.orchestra.run.smithi073.stdout: * updates: mirror.rackspace.com 2019-12-11T14:43:17.853 INFO:teuthology.orchestra.run.smithi073.stdout:7 packages excluded due to repository priority protections 2019-12-11T14:43:18.378 INFO:teuthology.orchestra.run.smithi073.stdout:Resolving Dependencies 2019-12-11T14:43:18.379 INFO:teuthology.orchestra.run.smithi073.stdout:--> Running transaction check 2019-12-11T14:43:18.379 INFO:teuthology.orchestra.run.smithi073.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-12-11T14:43:18.870 INFO:teuthology.orchestra.run.smithi073.stdout:--> Finished Dependency Resolution 2019-12-11T14:43:19.105 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:19.106 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies Resolved 2019-12-11T14:43:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:19.107 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T14:43:19.107 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2019-12-11T14:43:19.107 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T14:43:19.107 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2019-12-11T14:43:19.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:19.109 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 23 k 2019-12-11T14:43:19.109 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 27 k 2019-12-11T14:43:19.109 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading packages: 2019-12-11T14:43:19.222 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2019-12-11T14:43:19.224 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2019-12-11T14:43:19.225 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded 2019-12-11T14:43:19.226 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2019-12-11T14:43:19.790 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-11T14:43:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-11T14:43:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:20.164 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2019-12-11T14:43:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-12-11T14:43:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:20.164 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2019-12-11T14:43:20.325 INFO:teuthology.orchestra.run.smithi073.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-12-11T14:43:21.704 INFO:teuthology.orchestra.run.smithi073.stdout:Installing setuptools, pip, wheel...done. 2019-12-11T14:43:21.976 INFO:teuthology.orchestra.run.smithi073.stderr:Cache entry deserialization failed, entry ignored 2019-12-11T14:43:22.116 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting pip 2019-12-11T14:43:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-11T14:43:22.274 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: pip 2019-12-11T14:43:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: pip 9.0.1 2019-12-11T14:43:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling pip-9.0.1: 2019-12-11T14:43:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled pip-9.0.1 2019-12-11T14:43:22.948 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed pip-19.3.1 2019-12-11T14:43:23.216 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T14:43:23.717 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting setuptools==32.3.1 2019-12-11T14:43:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-11T14:43:23.758 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: setuptools 2019-12-11T14:43:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: setuptools 28.8.0 2019-12-11T14:43:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling setuptools-28.8.0: 2019-12-11T14:43:23.782 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-11T14:43:23.905 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed setuptools-32.3.1 2019-12-11T14:43:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T14:43:24.471 INFO:teuthology.orchestra.run.smithi073.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-11T14:43:24.528 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting nose>=1.0.0 2019-12-11T14:43:24.531 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-11T14:43:24.683 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting boto>=2.6.0 2019-12-11T14:43:24.691 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-11T14:43:25.255 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting boto3>=1.0.0 2019-12-11T14:43:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/be/04/7744980154abb220792503968cf0aac28a19f5c9be974635c747b553adf1/boto3-1.10.36-py2.py3-none-any.whl (128kB) 2019-12-11T14:43:25.424 INFO:teuthology.orchestra.run.smithi073.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-11T14:43:25.717 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting gevent>=1.0 2019-12-11T14:43:25.732 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T14:43:25.991 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting isodate>=0.4.4 2019-12-11T14:43:26.001 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-12-11T14:43:26.159 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting requests>=0.14.0 2019-12-11T14:43:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-12-11T14:43:26.495 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting pytz>=2011k 2019-12-11T14:43:26.504 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-12-11T14:43:26.714 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting ordereddict 2019-12-11T14:43:26.720 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-12-11T14:43:27.076 INFO:teuthology.orchestra.run.smithi073.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-12-11T14:43:27.440 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting lxml 2019-12-11T14:43:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T14:43:27.645 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-12-11T14:43:27.654 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-12-11T14:43:28.249 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting botocore<1.14.0,>=1.13.36 2019-12-11T14:43:28.258 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/08/e0/e47a793322fd68381e4cda4f98740c558c9ef2a87e71d06589048f59cbcb/botocore-1.13.36-py2.py3-none-any.whl (5.8MB) 2019-12-11T14:43:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-12-11T14:43:28.857 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-12-11T14:43:29.043 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-11T14:43:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T14:43:29.106 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting six 2019-12-11T14:43:29.116 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-11T14:43:29.190 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-12-11T14:43:29.200 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-12-11T14:43:29.286 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting idna<2.9,>=2.5 2019-12-11T14:43:29.298 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-12-11T14:43:29.426 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-12-11T14:43:29.435 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-12-11T14:43:29.553 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting certifi>=2017.4.17 2019-12-11T14:43:29.573 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-12-11T14:43:29.653 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting docutils<0.16,>=0.10 2019-12-11T14:43:29.666 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-12-11T14:43:29.838 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-12-11T14:43:29.848 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-12-11T14:43:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-12-11T14:43:29.961 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-12-11T14:43:29.993 INFO:teuthology.orchestra.run.smithi073.stdout:Building wheels for collected packages: ordereddict 2019-12-11T14:43:29.994 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for ordereddict (setup.py): started 2019-12-11T14:43:30.265 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-12-11T14:43:30.266 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=68a383f0c05810f54dc7a7545b722ccdbf1bf500677738d5bc76d36bf0a33a8c 2019-12-11T14:43:30.266 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-12-11T14:43:30.268 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully built ordereddict 2019-12-11T14:43:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-12-11T14:43:33.025 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 boto3-1.10.36 botocore-1.13.36 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-12-11T14:43:33.339 INFO:teuthology.orchestra.run.smithi073.stdout:running develop 2019-12-11T14:43:33.393 INFO:teuthology.orchestra.run.smithi073.stdout:running egg_info 2019-12-11T14:43:33.394 INFO:teuthology.orchestra.run.smithi073.stdout:creating s3tests.egg-info 2019-12-11T14:43:33.394 INFO:teuthology.orchestra.run.smithi073.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-12-11T14:43:33.394 INFO:teuthology.orchestra.run.smithi073.stdout:writing s3tests.egg-info/PKG-INFO 2019-12-11T14:43:33.394 INFO:teuthology.orchestra.run.smithi073.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-12-11T14:43:33.394 INFO:teuthology.orchestra.run.smithi073.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-12-11T14:43:33.395 INFO:teuthology.orchestra.run.smithi073.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-12-11T14:43:33.395 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-11T14:43:33.400 INFO:teuthology.orchestra.run.smithi073.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-11T14:43:33.400 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-11T14:43:33.400 INFO:teuthology.orchestra.run.smithi073.stdout:running build_ext 2019-12-11T14:43:33.400 INFO:teuthology.orchestra.run.smithi073.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-12-11T14:43:33.401 INFO:teuthology.orchestra.run.smithi073.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-12-11T14:43:33.404 INFO:teuthology.orchestra.run.smithi073.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-12-11T14:43:33.406 INFO:teuthology.orchestra.run.smithi073.stdout:Processing dependencies for s3tests==0.0.1 2019-12-11T14:43:33.467 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for isodate==0.6.0 2019-12-11T14:43:33.468 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: isodate 0.6.0 2019-12-11T14:43:33.468 INFO:teuthology.orchestra.run.smithi073.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-11T14:43:33.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.468 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.469 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for gevent==1.4.0 2019-12-11T14:43:33.469 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: gevent 1.4.0 2019-12-11T14:43:33.469 INFO:teuthology.orchestra.run.smithi073.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-11T14:43:33.469 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.470 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.470 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for bunch==1.0.1 2019-12-11T14:43:33.470 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: bunch 1.0.1 2019-12-11T14:43:33.471 INFO:teuthology.orchestra.run.smithi073.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-11T14:43:33.471 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.471 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.472 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for PyYAML==5.2 2019-12-11T14:43:33.472 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: PyYAML 5.2 2019-12-11T14:43:33.472 INFO:teuthology.orchestra.run.smithi073.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for boto3==1.10.36 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: boto3 1.10.36 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Adding boto3 1.10.36 to easy-install.pth file 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.473 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.475 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for boto==2.49.0 2019-12-11T14:43:33.475 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: boto 2.49.0 2019-12-11T14:43:33.475 INFO:teuthology.orchestra.run.smithi073.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-11T14:43:33.475 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.475 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for six==1.13.0 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: six 1.13.0 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Adding six 1.13.0 to easy-install.pth file 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for greenlet==0.4.15 2019-12-11T14:43:33.476 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: greenlet 0.4.15 2019-12-11T14:43:33.477 INFO:teuthology.orchestra.run.smithi073.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-11T14:43:33.477 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.477 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.478 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for s3transfer==0.2.1 2019-12-11T14:43:33.478 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: s3transfer 0.2.1 2019-12-11T14:43:33.478 INFO:teuthology.orchestra.run.smithi073.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-12-11T14:43:33.478 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for botocore==1.13.36 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: botocore 1.13.36 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:Adding botocore 1.13.36 to easy-install.pth file 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.481 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for jmespath==0.9.4 2019-12-11T14:43:33.481 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: jmespath 0.9.4 2019-12-11T14:43:33.481 INFO:teuthology.orchestra.run.smithi073.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for futures==3.3.0 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: futures 3.3.0 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.483 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for urllib3==1.25.7 2019-12-11T14:43:33.483 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: urllib3 1.25.7 2019-12-11T14:43:33.483 INFO:teuthology.orchestra.run.smithi073.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-12-11T14:43:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.484 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.484 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for python-dateutil==2.8.0 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: python-dateutil 2.8.0 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Searching for docutils==0.15.2 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Best match: docutils 0.15.2 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-12-11T14:43:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T14:43:33.486 INFO:teuthology.orchestra.run.smithi073.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-11T14:43:33.486 INFO:teuthology.orchestra.run.smithi073.stdout:Finished processing dependencies for s3tests==0.0.1 2019-12-11T14:43:33.493 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-12-11T14:43:33.546 INFO:tasks.s3tests:Configuring boto... 2019-12-11T14:43:33.548 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-11T14:43:33.634 INFO:teuthology.orchestra.run.smithi073:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-12-11T14:43:38.313 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-12-11T14:43:40.586 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-12-11T14:43:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-12-11T14:43:46.920 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-12-11T14:43:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-12-11T14:43:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-12-11T14:43:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-12-11T14:43:57.434 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-12-11T14:43:57.781 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-12-11T14:43:57.912 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-12-11T14:43:59.304 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-12-11T14:44:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-12-11T14:44:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-12-11T14:44:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-12-11T14:44:03.015 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-12-11T14:44:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-12-11T14:44:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-12-11T14:44:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-12-11T14:44:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-12-11T14:44:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-11T14:44:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-12-11T14:44:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-12-11T14:44:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-12-11T14:44:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-11T14:44:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-12-11T14:44:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-11T14:44:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-12-11T14:44:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-12-11T14:44:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-12-11T14:44:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-11T14:44:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-12-11T14:44:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-11T14:44:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-11T14:44:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-11T14:44:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-12-11T14:44:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-12-11T14:44:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-12-11T14:44:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-12-11T14:44:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-11T14:44:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-12-11T14:44:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-12-11T14:44:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-12-11T14:44:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-11T14:44:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-12-11T14:44:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-11T14:44:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-12-11T14:44:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-12-11T14:44:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-12-11T14:44:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-11T14:44:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-12-11T14:44:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-11T14:44:03.120 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-11T14:44:03.120 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-11T14:44:08.460 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-12-11T14:44:08.460 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-12-11T14:44:08.460 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-12-11T14:44:08.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-12-11T14:44:14.992 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-12-11T14:44:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-12-11T14:44:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-12-11T14:44:24.426 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-12-11T14:44:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-12-11T14:44:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-12-11T14:44:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-12-11T14:44:41.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-11T14:44:41.475 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-12-11T14:44:41.476 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-11T14:44:41.477 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-11T14:44:41.477 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-12-11T14:44:41.477 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-12-11T14:44:41.477 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-12-11T14:44:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-12-11T14:44:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-12-11T14:44:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-12-11T14:44:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-12-11T14:44:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-12-11T14:44:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:SKIP 2019-12-11T14:44:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-12-11T14:45:25.267 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:03:25.484 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.275 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:03:25.492 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.287 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:03:25.501 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.291 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:03:25.507 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.300 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:03:25.468 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.316 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:03:25.485 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.420 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:03:25.636 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.480 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:03:25.696 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:45:25.523 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:03:25.693 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:46:02.824 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-11T14:46:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-11T14:46:03.176 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-11T14:46:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-11T14:46:03.663 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-11T14:46:03.686 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-11T14:46:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-11T14:46:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-11T14:46:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-11T14:46:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-11T14:46:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-11T14:46:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-11T14:46:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-11T14:46:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-11T14:46:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-11T14:46:03.708 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-11T14:46:03.708 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-11T14:46:03.712 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-11T14:46:03.712 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-11T14:46:03.712 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-11T14:46:03.712 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-11T14:46:03.716 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-11T14:46:03.717 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-11T14:46:03.717 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-11T14:46:03.717 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-11T14:46:03.746 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-11T14:46:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-11T14:46:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-11T14:46:03.915 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-11T14:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-12-11T14:46:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-12-11T14:46:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-12-11T14:46:17.489 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-12-11T14:46:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-12-11T14:46:21.577 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-12-11T14:46:23.531 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-12-11T14:46:24.636 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-12-11T14:46:26.954 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-12-11T14:46:28.351 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-12-11T14:46:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-12-11T14:46:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-12-11T14:46:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-12-11T14:46:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-12-11T14:46:34.311 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-12-11T14:46:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-12-11T14:46:40.411 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-12-11T14:46:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-12-11T14:46:47.145 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-12-11T14:46:49.253 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-12-11T14:46:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-12-11T14:46:54.978 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-12-11T14:46:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-12-11T14:46:59.453 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-12-11T14:47:01.794 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-12-11T14:47:02.513 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-12-11T14:47:02.721 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-12-11T14:47:02.758 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-12-11T14:47:02.796 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-12-11T14:47:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-12-11T14:47:05.760 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-12-11T14:47:10.756 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-12-11T14:47:16.634 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-12-11T14:47:23.663 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-12-11T14:47:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-12-11T14:47:34.707 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-12-11T14:47:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-12-11T14:47:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_encoding_basic ... ok 2019-12-11T14:47:51.272 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_encoding_basic ... ok 2019-12-11T14:48:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-12-11T14:48:13.502 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-12-11T14:48:16.858 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-12-11T14:48:20.288 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-12-11T14:48:28.816 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-12-11T14:48:34.774 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-12-11T14:48:47.983 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-12-11T14:48:59.265 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-12-11T14:49:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-12-11T14:49:12.363 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-12-11T14:49:20.073 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-12-11T14:49:28.495 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-12-11T14:49:35.772 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-12-11T14:49:41.573 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:07:41.788 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.582 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:07:41.797 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.624 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:41.840 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.628 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:41.844 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.678 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:07:41.847 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.687 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:07:41.856 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.718 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:07:41.933 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.799 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:07:42.015 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.847 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:07:42.016 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:49:41.964 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-12-11T14:49:46.987 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-12-11T14:49:52.494 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-12-11T14:49:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-12-11T14:50:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-12-11T14:50:09.566 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-12-11T14:50:15.645 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-12-11T14:50:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-12-11T14:50:26.773 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-12-11T14:50:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-12-11T14:50:36.566 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:08:36.781 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.572 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:08:36.788 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.587 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:08:36.754 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.588 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:08:36.799 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.588 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:08:36.803 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.593 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:08:36.762 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.634 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:08:36.849 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.636 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:08:36.851 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:36.656 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:08:36.825 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:50:37.526 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-12-11T14:50:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-12-11T14:55:47.664 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:13:47.877 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.681 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:13:47.884 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.684 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:47.898 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.687 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:13:47.858 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.692 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:47.906 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.709 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:13:47.873 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.873 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:13:48.087 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.875 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:13:48.089 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:55:47.894 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:13:48.064 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.637 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:16:08.851 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.676 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:16:08.889 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.694 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:16:08.865 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.695 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:08.909 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.701 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:08.915 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.725 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:16:08.889 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.750 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:16:08.962 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.776 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:16:08.990 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T14:58:08.807 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:16:08.978 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.799 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:18:58.012 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.837 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:18:57.988 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.837 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:18:57.997 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.837 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:18:58.025 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.837 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:18:58.032 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.837 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:18:58.037 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.917 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:18:58.131 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.930 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:18:58.144 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:00:57.965 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:18:58.136 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.093 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:10.306 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.122 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:10.284 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.122 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:10.289 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.122 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:10.316 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.122 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:10.321 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.123 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:10.325 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.277 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:10.491 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.299 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:10.472 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:10.324 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:10.537 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.154 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:30.368 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.161 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:30.375 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.190 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:24:30.404 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.192 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:30.406 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.197 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:30.411 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.207 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:30.381 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.216 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:30.390 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.225 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:24:30.439 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:06:30.242 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:24:30.416 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:08:08.719 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-12-11T15:08:14.455 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-12-11T15:08:20.431 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-12-11T15:08:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-12-11T15:08:31.752 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-12-11T15:08:37.298 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-12-11T15:08:44.002 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-12-11T15:08:49.354 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-12-11T15:08:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-12-11T15:09:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-12-11T15:09:06.784 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-12-11T15:09:12.596 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-12-11T15:09:18.719 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-12-11T15:09:25.523 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-12-11T15:09:33.305 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-12-11T15:09:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-12-11T15:09:47.827 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-12-11T15:09:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-12-11T15:09:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-12-11T15:10:07.253 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-12-11T15:10:16.011 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-12-11T15:10:23.532 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-12-11T15:10:31.729 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-12-11T15:10:38.961 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-12-11T15:10:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-12-11T15:10:53.909 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-12-11T15:11:02.158 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-12-11T15:11:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-12-11T15:11:16.087 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-12-11T15:11:21.044 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:29:21.259 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.051 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:29:21.265 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.058 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:29:21.232 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.061 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:21.275 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.064 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:21.279 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.065 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:29:21.239 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.281 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:29:21.455 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.297 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:29:21.502 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:21.298 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:29:21.512 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:11:46.207 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-12-11T15:12:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-12-11T15:12:22.959 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-12-11T15:12:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-12-11T15:12:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-12-11T15:12:44.207 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-12-11T15:12:49.553 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-12-11T15:12:56.259 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-12-11T15:13:02.857 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-12-11T15:13:12.922 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-12-11T15:13:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-12-11T15:13:24.531 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-12-11T15:13:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-12-11T15:13:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-12-11T15:13:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-12-11T15:13:58.211 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-12-11T15:14:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-12-11T15:14:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-12-11T15:14:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-12-11T15:14:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-12-11T15:14:02.820 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-12-11T15:14:06.461 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-12-11T15:14:11.828 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-12-11T15:14:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-12-11T15:14:18.184 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-12-11T15:14:19.931 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-12-11T15:14:22.526 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-12-11T15:14:34.123 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-12-11T15:14:42.887 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-12-11T15:14:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-12-11T15:14:48.942 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-12-11T15:14:51.622 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:32:51.837 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.662 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:51.877 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.665 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:32:51.880 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.671 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:51.887 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.709 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:32:51.883 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.715 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:32:51.889 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.760 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:32:51.975 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.770 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:32:51.985 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.826 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:32:52.000 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:14:51.897 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-12-11T15:14:55.173 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-12-11T15:14:59.395 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-12-11T15:15:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-12-11T15:15:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-12-11T15:15:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-12-11T15:15:13.576 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-12-11T15:15:18.601 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-12-11T15:15:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-12-11T15:15:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-12-11T15:15:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-12-11T15:15:32.861 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-12-11T15:15:36.172 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-12-11T15:15:40.062 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-12-11T15:15:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-12-11T15:15:48.212 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-12-11T15:15:51.947 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-12-11T15:15:55.396 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-12-11T15:15:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-12-11T15:16:02.479 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-12-11T15:16:07.619 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-12-11T15:16:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-12-11T15:16:14.145 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-12-11T15:16:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-12-11T15:16:19.029 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-12-11T15:16:20.885 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-12-11T15:16:24.832 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-12-11T15:16:28.131 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-12-11T15:16:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-12-11T15:16:33.048 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:34:33.264 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.053 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:34:33.269 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.061 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:34:33.276 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.064 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:34:33.280 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.065 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:34:33.239 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.082 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:34:33.256 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.135 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:34:33.350 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.146 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:34:33.362 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.209 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:34:33.383 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:16:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-12-11T15:16:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-12-11T15:16:37.467 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-12-11T15:16:39.570 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-12-11T15:16:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-12-11T15:16:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-12-11T15:16:46.599 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-12-11T15:16:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-12-11T15:16:52.678 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-12-11T15:16:55.674 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-12-11T15:16:58.264 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-12-11T15:17:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-12-11T15:17:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-12-11T15:17:07.777 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-12-11T15:17:12.425 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-12-11T15:17:16.420 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-12-11T15:17:21.064 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-12-11T15:17:25.431 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-12-11T15:17:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-12-11T15:17:36.098 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-12-11T15:17:41.457 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-12-11T15:17:47.149 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-12-11T15:17:50.990 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-12-11T15:17:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-12-11T15:18:02.269 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-12-11T15:18:06.531 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-12-11T15:18:11.109 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-12-11T15:18:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-12-11T15:18:22.678 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-12-11T15:18:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-12-11T15:18:36.873 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-12-11T15:18:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-12-11T15:18:48.917 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-12-11T15:18:52.178 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-12-11T15:18:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-12-11T15:18:59.753 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-12-11T15:19:05.107 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-12-11T15:19:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-12-11T15:19:12.194 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-12-11T15:19:20.559 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-12-11T15:19:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-12-11T15:19:30.576 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-12-11T15:19:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-12-11T15:19:38.046 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-12-11T15:19:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-12-11T15:19:44.404 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-12-11T15:19:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-12-11T15:19:53.080 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-12-11T15:19:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-12-11T15:19:57.441 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-12-11T15:19:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-12-11T15:19:58.518 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-12-11T15:19:58.897 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-12-11T15:20:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-12-11T15:20:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-12-11T15:20:09.530 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-12-11T15:20:11.878 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-12-11T15:20:14.492 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-12-11T15:20:17.573 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-12-11T15:20:20.070 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-12-11T15:20:22.708 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-12-11T15:20:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-12-11T15:20:29.354 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-12-11T15:20:33.149 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-12-11T15:20:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-12-11T15:20:40.515 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-12-11T15:20:46.979 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-12-11T15:20:51.621 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-12-11T15:20:58.133 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-12-11T15:21:05.654 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-12-11T15:21:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-12-11T15:21:17.149 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-12-11T15:21:21.984 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-12-11T15:21:27.094 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-12-11T15:21:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-12-11T15:21:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-12-11T15:21:40.793 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-12-11T15:21:45.692 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:39:45.907 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.699 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:39:45.914 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.708 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:45.924 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.714 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:45.930 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.726 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:39:45.898 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.737 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:39:45.904 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.943 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:39:46.159 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.951 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-12-11T15:21:45.976 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:39:46.191 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:45.996 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:39:46.169 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:21:50.537 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-12-11T15:21:54.939 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-12-11T15:22:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-12-11T15:22:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-12-11T15:22:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-12-11T15:22:15.173 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-12-11T15:22:20.652 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-12-11T15:22:25.044 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-12-11T15:22:27.714 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-12-11T15:22:32.541 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-12-11T15:22:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-12-11T15:22:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-12-11T15:22:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-12-11T15:23:03.190 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-12-11T15:23:10.944 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-12-11T15:23:13.114 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:41:13.329 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.143 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:13.358 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.148 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:41:13.364 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.164 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:41:13.336 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.164 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:13.379 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.168 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:41:13.341 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.197 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:41:13.411 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.216 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:41:13.431 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:13.238 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:41:13.411 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:23:17.621 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-12-11T15:23:25.248 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-12-11T15:23:32.482 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-12-11T15:23:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-12-11T15:23:53.689 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-12-11T15:24:04.141 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-12-11T15:24:08.549 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:42:08.764 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.553 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:42:08.769 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.591 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.806 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.600 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:42:08.773 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.605 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:42:08.821 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.611 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.826 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.621 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:42:08.795 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.657 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:42:08.872 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:08.674 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:42:08.847 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:24:14.780 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-12-11T15:24:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-12-11T15:24:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-12-11T15:24:30.246 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-12-11T15:24:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-12-11T15:24:37.014 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-12-11T15:24:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-12-11T15:24:46.172 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-12-11T15:24:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-12-11T15:24:54.593 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-12-11T15:25:25.854 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-12-11T15:25:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-12-11T15:25:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-12-11T15:25:49.410 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-12-11T15:25:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-12-11T15:25:59.056 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-12-11T15:26:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-12-11T15:26:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-12-11T15:26:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-12-11T15:26:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-12-11T15:26:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-12-11T15:26:47.445 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-12-11T15:26:56.059 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:44:56.274 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.065 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:44:56.279 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.072 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:44:56.287 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.078 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:44:56.292 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.078 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:44:56.250 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.093 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:44:56.266 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.186 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:44:56.401 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.193 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:44:56.405 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:26:56.275 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:44:56.448 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:27:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-12-11T15:27:03.769 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-12-11T15:27:07.154 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-12-11T15:27:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-12-11T15:27:55.474 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-12-11T15:28:37.899 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:28:37.795+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:29:12.361 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-12-11T15:29:15.905 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-12-11T15:29:24.623 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-12-11T15:29:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-12-11T15:29:52.514 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-12-11T15:30:06.775 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-12-11T15:30:23.711 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:30:23.628+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:30:51.858 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:30:51.818+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:31:03.294 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:31:03.257+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:31:03.864 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-12-11T15:31:29.591 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:31:29.546+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:31:34.766 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:49:34.981 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.796 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:49:35.011 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.806 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:35.022 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.818 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:35.034 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.856 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:49:35.029 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:49:35.038 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.936 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:49:35.151 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:34.941 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:49:35.157 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:35.056 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:49:35.229 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:31:55.175 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:31:54.901+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:31:58.398 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-12-11T15:32:06.003 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:50:06.218 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.009 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:50:06.225 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.018 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:06.234 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.022 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:06.238 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.033 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:50:06.206 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.041 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:50:06.214 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.055 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:50:06.271 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.062 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:50:06.278 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:06.161 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:50:06.334 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:32:44.440 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:32:44.428+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:33:03.584 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:33:03.534+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:33:06.057 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:33:06.007+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:33:32.272 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-12-11T15:33:32.782 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:33:32.588+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:34:00.522 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:34:00.497+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:34:19.852 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:34:19.843+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:34:51.832 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:34:51.808+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:35:11.197 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:35:11.155+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:35:38.173 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:35:38.140+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:36:02.802 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:36:02.721+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:36:37.374 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:36:37.359+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:37:02.399 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:37:02.370+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:37:19.077 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:55:19.293 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.085 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:55:19.301 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.091 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:19.307 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.097 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:19.313 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.101 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:55:19.274 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.107 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:55:19.280 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.250 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:55:19.466 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.278 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:55:19.494 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:19.302 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:55:19.475 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:37:51.189 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:37:51.165+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:38:18.684 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:38:18.385+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:38:21.183 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-12-11T15:39:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-12-11T15:39:49.787 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:39:49.774+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:39:56.151 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:57:56.367 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.182 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:56.398 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.192 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:57:56.406 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.204 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:56.421 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.265 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:57:56.438 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.275 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:01:57:56.491 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.279 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:01:57:56.495 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.280 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:57:56.454 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:39:56.369 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:01:57:56.542 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:40:01.860 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:40:01.797+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:40:16.234 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:40:16.213+0000 40262700 -1 handle_data failed with exit code -5 2019-12-11T15:40:35.035 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:40:34.933+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:40:50.571 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:40:50.549+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:41:04.321 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T15:41:04.220+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-11T15:41:04.905 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-12-11T15:41:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-12-11T15:41:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-12-11T15:42:12.589 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-12-11T15:42:26.796 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-12-11T15:42:30.523 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-12-11T15:42:31.225 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:00:31.442 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.235 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:00:31.452 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.242 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:00:31.458 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.244 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:00:31.417 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.245 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:00:31.463 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.250 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:00:31.423 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.350 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:00:31.567 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.355 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:00:31.572 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:31.381 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:00:31.554 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:42:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-12-11T15:43:10.304 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload_encoding ... ok 2019-12-11T15:43:18.454 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-12-11T15:43:25.581 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-12-11T15:43:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-12-11T15:43:34.907 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-12-11T15:43:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-12-11T15:44:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-12-11T15:44:08.076 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-12-11T15:44:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-12-11T15:44:23.653 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-12-11T15:44:33.023 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-12-11T15:44:40.110 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-12-11T15:44:50.405 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-12-11T15:45:02.555 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-12-11T15:45:14.368 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-12-11T15:45:29.180 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-12-11T15:45:46.674 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-12-11T15:45:56.348 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-12-11T15:46:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-12-11T15:46:22.509 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-12-11T15:46:26.287 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-12-11T15:46:44.324 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-12-11T15:46:48.120 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-12-11T15:46:53.014 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-12-11T15:46:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-12-11T15:47:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-12-11T15:47:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-12-11T15:47:43.657 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:05:43.874 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.663 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:05:43.880 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.667 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:05:43.884 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.671 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:05:43.888 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.674 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:05:43.846 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.678 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:05:43.850 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.841 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:05:44.057 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:05:44.037 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:47:43.915 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:05:44.132 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.664 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:06:17.882 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.717 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:06:17.933 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.720 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:06:17.937 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.725 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:06:17.942 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.757 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:06:17.929 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.761 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:06:17.978 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.762 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:06:17.980 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.768 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:06:17.936 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:48:17.810 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:06:17.982 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:51:42.129 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-12-11T15:52:32.011 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-12-11T15:52:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-12-11T15:52:55.577 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:10:55.794 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.589 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:10:55.799 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.597 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:10:55.815 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.600 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:10:55.771 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.603 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:10:55.820 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.609 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:10:55.780 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.736 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:10:55.953 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.773 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:10:55.990 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:55.821 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:10:55.984 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:52:58.512 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-12-11T15:53:12.244 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-12-11T15:54:43.793 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-12-11T15:56:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-12-11T15:56:39.193 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:14:39.410 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.215 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:14:39.432 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.247 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:14:39.464 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.251 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:14:39.422 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.252 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:14:39.469 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.258 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:14:39.429 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.325 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:14:39.542 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.347 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:14:39.564 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:56:39.390 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:14:39.561 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.791 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:16:06.007 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.809 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:16:06.013 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.818 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:16:05.987 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.828 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:16:05.996 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.829 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:16:06.040 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.829 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:16:06.045 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.878 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:16:06.095 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.898 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:16:06.115 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T15:58:05.930 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:16:06.101 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:02:54.221 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-12-11T16:03:16.488 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:21:16.705 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.497 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:21:16.713 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.502 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:21:16.719 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.505 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:21:16.722 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.524 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:21:16.693 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.528 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:21:16.697 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.675 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:21:16.891 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.764 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:21:16.933 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:03:16.778 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:21:16.994 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:04:28.594 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-12-11T16:05:00.657 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:00.873 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.685 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:00.901 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.721 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:00.937 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.737 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:00.953 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.737 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:00.906 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.743 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:00.912 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.760 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:00.977 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.794 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:01.010 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:00.802 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:00.971 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-12-11T16:05:06.036 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:06.252 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.038 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:06.255 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.055 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:23:06.272 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.087 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:06.303 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.097 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:06.314 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.100 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:06.269 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.105 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:06.274 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.115 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:23:06.332 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:06.123 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:23:06.292 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:05:31.739 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-12-11T16:05:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-12-11T16:06:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-12-11T16:06:33.447 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-12-11T16:06:55.405 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-12-11T16:07:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... Exception in thread Thread-55: 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:22.771 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:22.772 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:22.773 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:22.862 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-51: 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:22.864 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-54: 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:22.953 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:22.954 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:22.955 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-53: 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:23.473 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:23.474 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:23.475 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-61: 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:38.545 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:38.546 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:39.160 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-63: 2019-12-11T16:07:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:39.281 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:39.281 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:39.281 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:39.281 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:39.282 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-64: 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:39.310 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:39.311 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-62: 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:39.312 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:39.313 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:39.313 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:39.313 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:39.313 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:39.313 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:39.314 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:39.314 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:39.314 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:39.314 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:51.964 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-73: 2019-12-11T16:07:51.964 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:51.965 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:51.966 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-74: 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:52.053 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:52.054 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:52.055 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-72: 2019-12-11T16:07:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:52.570 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:52.571 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:52.572 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:52.572 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:52.572 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:52.572 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:07:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-75: 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:07:52.633 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:07:52.634 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-82: 2019-12-11T16:08:04.772 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:04.772 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:04.772 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:04.772 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:04.772 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:04.773 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:04.774 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:04.882 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-83: 2019-12-11T16:08:04.882 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:04.883 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:04.884 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:04.884 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:04.884 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:04.884 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:04.884 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:04.897 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-81: 2019-12-11T16:08:04.897 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:04.897 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:04.897 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:04.898 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:04.899 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:04.899 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:04.899 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:04.899 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:04.986 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-85: 2019-12-11T16:08:04.986 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:04.987 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:04.988 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:04.988 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:04.988 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:04.988 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:04.989 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:04.989 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-92: 2019-12-11T16:08:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:16.444 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:16.444 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:16.444 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:16.445 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:16.446 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-94: 2019-12-11T16:08:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:16.516 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:16.517 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:16.518 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:16.518 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:16.518 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:16.518 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-95: 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:16.643 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:16.644 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:16.645 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-93: 2019-12-11T16:08:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:16.804 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:16.804 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:16.804 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:16.805 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:16.806 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:16.806 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:26.733 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:26:26.949 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.742 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:26:26.957 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.749 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:26:26.965 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.752 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:26:26.968 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.753 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:26:26.922 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.763 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:26:26.931 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.873 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:26:27.089 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.892 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:26:27.062 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:26.917 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:26:27.134 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:08:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:ok 2019-12-11T16:08:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... Exception in thread Thread-105: 2019-12-11T16:08:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.368 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.368 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.368 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.369 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-101: 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.370 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-102: 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.372 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.373 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.374 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-104: 2019-12-11T16:08:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.446 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-106: 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.842 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.843 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.909 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-107: 2019-12-11T16:08:34.909 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.909 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.909 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.909 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.910 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.910 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.910 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.910 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.910 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.911 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.911 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.911 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.911 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.930 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-109: 2019-12-11T16:08:34.930 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.930 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.930 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.931 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.931 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.931 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.931 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.933 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.933 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:34.939 INFO:teuthology.orchestra.run.smithi073.stderr:Exception in thread Thread-108: 2019-12-11T16:08:34.940 INFO:teuthology.orchestra.run.smithi073.stderr:Traceback (most recent call last): 2019-12-11T16:08:34.940 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-11T16:08:34.940 INFO:teuthology.orchestra.run.smithi073.stderr: self.run() 2019-12-11T16:08:34.940 INFO:teuthology.orchestra.run.smithi073.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-11T16:08:34.940 INFO:teuthology.orchestra.run.smithi073.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-11T16:08:34.941 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8647, in _do_create_object 2019-12-11T16:08:34.941 INFO:teuthology.orchestra.run.smithi073.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-11T16:08:34.941 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-11T16:08:34.941 INFO:teuthology.orchestra.run.smithi073.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-11T16:08:34.942 INFO:teuthology.orchestra.run.smithi073.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-11T16:08:34.942 INFO:teuthology.orchestra.run.smithi073.stderr: raise error_class(parsed_response, operation_name) 2019-12-11T16:08:34.942 INFO:teuthology.orchestra.run.smithi073.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-11T16:08:34.942 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T16:08:46.472 INFO:teuthology.orchestra.run.smithi073.stderr:ok 2019-12-11T16:08:50.834 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-12-11T16:08:56.503 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-12-11T16:09:06.544 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-12-11T16:09:08.620 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-12-11T16:09:11.584 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-12-11T16:09:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-12-11T16:09:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-12-11T16:09:19.600 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-12-11T16:09:24.328 INFO:teuthology.orchestra.run.smithi073.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-12-11T16:09:30.723 INFO:teuthology.orchestra.run.smithi073.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-12-11T16:09:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-12-11T16:09:46.574 INFO:teuthology.orchestra.run.smithi073.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-12-11T16:09:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-12-11T16:10:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-12-11T16:10:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-12-11T16:10:09.724 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-12-11T16:10:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-12-11T16:10:18.253 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-12-11T16:10:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-12-11T16:10:26.071 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-12-11T16:10:28.728 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-12-11T16:10:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-12-11T16:10:38.457 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-12-11T16:10:42.648 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-12-11T16:10:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-12-11T16:10:46.599 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-12-11T16:10:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-12-11T16:10:51.016 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-12-11T16:12:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-12-11T16:12:47.561 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-12-11T16:12:50.737 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-12-11T16:12:55.934 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-12-11T16:13:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-12-11T16:13:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-12-11T16:13:06.873 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-12-11T16:13:22.303 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:22.519 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.309 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:22.526 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.324 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:22.541 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.354 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:22.570 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.398 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:22.568 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.405 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:22.575 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.429 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:22.642 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.469 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:22.685 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:22.595 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:22.765 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.462 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:38.678 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.476 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:38.687 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.489 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:38.656 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.490 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:38.695 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.490 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:38.699 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.494 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:38.665 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.507 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:31:38.718 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.520 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:31:38.735 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:13:38.561 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:31:38.731 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:14:22.882 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-12-11T16:14:51.122 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-12-11T16:15:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-12-11T16:15:26.644 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-12-11T16:15:29.648 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-12-11T16:15:33.692 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-12-11T16:15:38.093 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-12-11T16:15:41.884 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-12-11T16:15:44.529 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-12-11T16:15:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-12-11T16:15:52.412 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-12-11T16:15:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-12-11T16:16:07.479 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-12-11T16:16:17.702 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-12-11T16:16:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-12-11T16:16:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-12-11T16:16:42.012 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-12-11T16:16:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-12-11T16:16:55.854 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-12-11T16:17:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-12-11T16:17:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-12-11T16:17:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-12-11T16:17:24.052 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-12-11T16:17:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-12-11T16:17:39.019 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-12-11T16:17:44.769 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-12-11T16:17:51.051 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-12-11T16:18:00.452 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-12-11T16:18:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-12-11T16:18:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-12-11T16:18:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-12-11T16:18:52.318 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:36:52.534 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.325 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:36:52.542 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.338 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:36:52.555 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.340 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:36:52.512 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.345 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:36:52.562 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.369 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:36:52.535 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.519 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:36:52.735 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.542 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:36:52.758 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:18:52.599 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:36:52.771 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:19:51.844 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-12-11T16:20:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-12-11T16:20:15.416 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-12-11T16:20:26.218 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-12-11T16:20:43.102 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-12-11T16:20:55.274 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-12-11T16:21:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-12-11T16:21:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-12-11T16:21:20.941 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-12-11T16:21:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-12-11T16:21:27.737 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-12-11T16:21:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-12-11T16:21:32.444 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-12-11T16:21:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-12-11T16:21:36.481 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-12-11T16:21:39.134 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-12-11T16:21:42.394 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-12-11T16:21:45.852 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-12-11T16:21:48.796 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:39:49.013 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.807 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:39:49.024 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.864 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:39:49.076 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.864 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:39:49.078 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.885 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:39:49.056 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.888 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:39:49.059 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.938 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:39:49.155 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:48.963 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:39:49.178 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:49.048 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:39:49.220 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:21:57.178 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-12-11T16:22:01.818 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-12-11T16:22:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-12-11T16:22:22.259 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-12-11T16:22:25.409 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-12-11T16:22:40.386 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-12-11T16:22:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-12-11T16:23:08.346 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-12-11T16:23:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-12-11T16:23:30.268 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-12-11T16:23:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-12-11T16:23:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-12-11T16:23:54.830 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-12-11T16:24:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-12-11T16:24:04.225 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:42:04.441 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.235 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:42:04.452 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.244 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:42:04.459 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.244 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:42:04.461 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.248 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:42:04.419 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.265 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:42:04.431 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.344 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:42:04.560 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.348 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:42:04.564 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:04.415 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:42:04.587 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:24:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-12-11T16:24:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-12-11T16:24:18.638 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-12-11T16:24:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-12-11T16:24:42.179 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-12-11T16:24:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-12-11T16:24:54.767 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_bucket_policy_status ... ok 2019-12-11T16:24:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_public_acl_bucket_policy_status ... ok 2019-12-11T16:25:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_authpublic_acl_bucket_policy_status ... ok 2019-12-11T16:25:03.686 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_publicpolicy_acl_bucket_policy_status ... ok 2019-12-11T16:25:06.576 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_nonpublicpolicy_acl_bucket_policy_status ... ok 2019-12-11T16:25:10.124 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_nonpublicpolicy_deny_bucket_policy_status ... ok 2019-12-11T16:25:12.209 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_get_default_public_block ... ok 2019-12-11T16:25:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_put_public_block ... ok 2019-12-11T16:25:18.785 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_block_public_put_bucket_acls ... ok 2019-12-11T16:25:22.183 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_block_public_object_canned_acls ... ok 2019-12-11T16:25:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_block_public_policy ... ok 2019-12-11T16:25:30.694 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_ignore_public_acls ... ok 2019-12-11T16:25:35.426 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_s3.test_user_policy ... ok 2019-12-11T16:25:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-12-11T16:29:15.048 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:47:15.264 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.054 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:47:15.270 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.065 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:47:15.281 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.071 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:47:15.288 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.073 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:47:15.247 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.080 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:47:15.254 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.312 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:47:15.485 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.326 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:47:15.542 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:29:15.329 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:47:15.545 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.131 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:48:10.347 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.177 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:48:10.393 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.181 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:48:10.355 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.187 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:48:10.403 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.187 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:48:10.360 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.191 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:48:10.407 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.216 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:48:10.432 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.233 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:48:10.406 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:30:10.241 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:48:10.455 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.005 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:52:26.221 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.029 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:52:26.201 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.030 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:52:26.231 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.030 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:52:26.241 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.034 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:52:26.248 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.038 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:52:26.212 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.170 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:52:26.386 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.199 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:52:26.415 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:34:26.207 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:52:26.380 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.663 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:56:31.879 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.698 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:56:31.914 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.750 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:56:31.919 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.750 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:56:31.921 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.778 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:56:31.994 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.779 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:56:31.996 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.828 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:56:32.044 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.874 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:56:32.090 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:38:31.874 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:56:32.047 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.092 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:57:37.309 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.100 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:57:37.316 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.113 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:57:37.330 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.119 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:57:37.292 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.120 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:57:37.337 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.133 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:57:37.307 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.173 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:02:57:37.389 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.187 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:02:57:37.404 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:39:37.272 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:02:57:37.445 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.243 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:02:49.460 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.253 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:02:49.470 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.262 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:02:49.479 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.266 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:02:49.439 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.266 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:02:49.483 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.272 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:02:49.446 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.435 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:02:49.652 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.463 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:02:49.677 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:44:49.503 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:02:49.676 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.032 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:18.249 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.068 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:18.285 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.120 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:18.337 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.134 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:18.350 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.138 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:18.312 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.148 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:18.321 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.149 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:18.366 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.200 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:18.417 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:18.316 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:18.489 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.268 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:53.484 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.299 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:53.516 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.321 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:53.538 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.324 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:53.541 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.334 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:04:53.551 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.346 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:53.520 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.356 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:53.529 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.359 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:04:53.575 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:46:53.389 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:04:53.562 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.917 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:08:00.133 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.925 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:08:00.141 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.937 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:08:00.153 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.945 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:08:00.159 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.950 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:08:00.120 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:49:59.972 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:08:00.145 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:50:00.046 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:08:00.263 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:50:00.060 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:08:00.277 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:50:00.128 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:08:00.301 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.918 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:14.135 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.929 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:14.145 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.933 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:14.149 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.938 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:14.154 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.947 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:14.120 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:13.975 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:14.147 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:14.179 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:14.395 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:14.190 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:14.362 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:14.190 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:14.407 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.433 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:15.650 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.434 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:15.651 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.444 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:13:15.661 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.574 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:15.790 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.575 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:15.792 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.584 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:13:15.801 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.585 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:15.758 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.587 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:15.760 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T16:55:15.600 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:13:15.773 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.038 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:18:24.255 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.041 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:18:24.258 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.055 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:18:24.271 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.059 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:18:24.276 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.063 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:18:24.236 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.082 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:18:24.255 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.234 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:18:24.450 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.269 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:18:24.441 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:00:24.282 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:18:24.498 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.292 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:21:36.509 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.324 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:21:36.540 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.325 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:21:36.541 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.356 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:21:36.573 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.389 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:21:36.562 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.399 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:21:36.572 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.411 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:21:36.628 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.449 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:21:36.666 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:03:36.541 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:21:36.714 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.199 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:23:34.415 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.239 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:23:34.455 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.240 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:23:34.456 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.256 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:23:34.430 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.258 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:23:34.432 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.259 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:23:34.476 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.328 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:23:34.545 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.332 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:23:34.549 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:05:34.385 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:23:34.558 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.863 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:28:47.080 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.898 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:28:47.114 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.926 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:28:47.143 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.940 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:28:47.156 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.945 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:28:47.118 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:46.947 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:28:47.120 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:47.128 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:28:47.302 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:47.137 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:28:47.353 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:10:47.173 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:28:47.389 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.857 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:29:58.073 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.917 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:29:58.133 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.922 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:29:58.138 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.926 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:29:58.143 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.944 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:29:58.118 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.951 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:29:58.125 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.962 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:29:58.179 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:57.992 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:29:58.209 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:11:58.038 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:29:58.212 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.424 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:38:19.639 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.428 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:38:19.644 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.445 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:38:19.662 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.469 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:38:19.685 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.478 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:38:19.652 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.509 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:38:19.681 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.716 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:38:19.931 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.719 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:38:19.935 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:20:19.745 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:38:19.918 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.822 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:39:09.038 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.834 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:39:09.050 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.844 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:39:09.060 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.847 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:39:09.063 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.853 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:39:09.027 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:39:09.039 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.894 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:39:09.110 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.910 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:39:09.126 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:21:08.953 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:39:09.127 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.649 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:44:21.865 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.655 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:44:21.871 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.669 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:44:21.885 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.674 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:44:21.889 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.682 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:44:21.856 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.694 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:44:21.868 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.851 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:44:22.066 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:21.893 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:44:22.109 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:26:22.002 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:44:22.176 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.206 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:46:41.422 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.240 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:46:41.455 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.262 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:46:41.478 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.270 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:46:41.485 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.305 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:46:41.479 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.310 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:46:41.484 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.320 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:46:41.536 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.349 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:46:41.565 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:28:41.407 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:46:41.581 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.728 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:49:31.943 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.735 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:49:31.951 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.746 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:49:31.962 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.750 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:49:31.966 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.772 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:49:31.946 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.779 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:49:31.953 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.847 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:49:32.062 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.904 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:49:32.115 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:31:31.933 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:49:32.107 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.710 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:54:43.925 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.719 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:54:43.935 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.729 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:54:43.903 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.730 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:54:43.945 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.733 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:54:43.949 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.734 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:54:43.909 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.934 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:54:44.149 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.940 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:54:44.156 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:36:43.946 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:54:44.120 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.725 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:55:02.940 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.763 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:55:02.978 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.792 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:55:03.007 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.797 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:55:03.012 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.799 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:55:02.974 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.800 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:55:03.015 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.805 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:55:02.980 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.823 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:55:03.039 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:37:02.828 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:55:03.002 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.382 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:59:55.598 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.391 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:59:55.607 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.405 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:59:55.621 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.408 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:59:55.624 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.420 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:59:55.594 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.424 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:59:55.598 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.573 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:03:59:55.788 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.574 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:03:59:55.790 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:41:55.636 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:03:59:55.810 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.061 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:03:24.277 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.095 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:03:24.311 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.107 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:03:24.323 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.114 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:03:24.330 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.122 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:03:24.296 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.128 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:03:24.303 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.200 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:03:24.416 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.233 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:03:24.408 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:45:24.240 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:03:24.456 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.624 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:05:05.840 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.628 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:05:05.844 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.636 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:05:05.853 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.639 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:05:05.855 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.650 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:05:05.824 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.661 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:05:05.835 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.713 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:05:05.929 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.729 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:05:05.945 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:47:05.756 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:05:05.931 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.603 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:10:17.819 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.605 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:10:17.822 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.626 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:10:17.801 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.642 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:10:17.817 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.795 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:10:18.011 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.796 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:10:18.012 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.799 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:10:18.015 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.840 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:10:18.014 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:52:17.998 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:10:18.215 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.625 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:11:45.842 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.648 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:11:45.864 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.689 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:11:45.905 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.690 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:11:45.907 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.710 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:11:45.926 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.723 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:11:45.898 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.726 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:11:45.900 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.763 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:11:45.980 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:53:45.829 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:11:46.004 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:55:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-11T17:55:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-11T17:55:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-11T17:55:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-11T17:55:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-11T17:55:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-11T17:55:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-11T17:55:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-11T17:55:08.563 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-11T17:55:08.897 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-11T17:55:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-11T17:55:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-11T17:55:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-11T17:55:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-11T17:55:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-11T17:55:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-11T17:55:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-11T17:55:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-11T17:55:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-11T17:55:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-11T17:55:08.944 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-11T17:55:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-11T17:55:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-11T17:55:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-11T17:55:08.946 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-11T17:55:08.947 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-11T17:55:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-11T17:55:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-11T17:55:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-11T17:55:08.951 INFO:teuthology.orchestra.run.smithi073.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-11T17:55:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-11T17:55:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-11T17:55:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-11T17:55:09.130 INFO:teuthology.orchestra.run.smithi073.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-11T17:55:09.130 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T17:55:09.130 INFO:teuthology.orchestra.run.smithi073.stderr:---------------------------------------------------------------------- 2019-12-11T17:55:09.130 INFO:teuthology.orchestra.run.smithi073.stderr:Ran 627 tests in 11495.129s 2019-12-11T17:55:09.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2019-12-11T17:55:09.131 INFO:teuthology.orchestra.run.smithi073.stderr:OK (SKIP=75) 2019-12-11T17:55:09.182 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-12-11T17:55:09.182 INFO:teuthology.orchestra.run.smithi073:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-12-11T17:55:09.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-11T17:55:09.296 INFO:tasks.s3tests:Cleaning up boto... 2019-12-11T17:55:09.297 INFO:teuthology.orchestra.run.smithi073:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-11T17:55:09.344 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-12-11T17:55:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.464+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.488+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.488+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.497+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.497+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.501+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.501+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.520 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.512+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.684+0000 7fbcc57aeec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T17:55:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.684+0000 7fbcc57aeec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T17:55:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.684+0000 7fbcc57aeec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T17:55:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.684+0000 7fbcc57aeec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T17:55:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.684+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.694+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:09.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.694+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.706+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:09.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.706+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.715+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.715+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.728 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.723+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:09.728 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.723+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.732 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.727+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.732 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.727+0000 7fbcc57aeec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T17:55:09.733 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.727+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.736 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.731+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.737 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.731+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.743 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.738+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.738+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.746+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:09.751 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.746+0000 7fbcc57aeec0 20 zonegroup default 2019-12-11T17:55:09.752 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.746+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.750+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.750+0000 7fbcc57aeec0 10 Cannot find current period zone using local zone 2019-12-11T17:55:09.755 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.750+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.754+0000 7fbcc57aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:09.759 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.754+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.761+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.761+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:09.784 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.779+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:09.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.779+0000 7fbcc57aeec0 20 zone default found 2019-12-11T17:55:09.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.779+0000 7fbcc57aeec0 20 started sync module instance, tier type = 2019-12-11T17:55:09.785 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:09.779+0000 7fbcc57aeec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T17:55:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=0 2019-12-11T17:55:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=1 2019-12-11T17:55:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=2 2019-12-11T17:55:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=3 2019-12-11T17:55:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=4 2019-12-11T17:55:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=5 2019-12-11T17:55:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.156+0000 7fbcc57aeec0 20 add_watcher() i=6 2019-12-11T17:55:10.192 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.187+0000 7fbcc57aeec0 20 add_watcher() i=7 2019-12-11T17:55:10.192 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.187+0000 7fbcc57aeec0 2 all 8 watchers are set, enabling cache 2019-12-11T17:55:10.193 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.187+0000 7fbc837de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T17:55:10.195 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.190+0000 7fbcb29d8700 0 -- 172.21.15.73:0/2258397289 >> v2:172.21.15.150:3300/0 conn(0x55e44f1bff60 msgr2=0x55e44f1c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T17:55:10.236 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:10.231+0000 7fbcb21d7700 0 -- 172.21.15.73:0/1857905651 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x55e44f1d62a0 msgr2=0x55e44f1d86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T17:55:11.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.936+0000 7fbbf1ffb700 20 reqs_thread_entry: start 2019-12-11T17:55:11.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.936+0000 7fbbeb7fe700 20 reqs_thread_entry: start 2019-12-11T17:55:11.942 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.936+0000 7fbcc57aeec0 20 init_complete bucket index max shards: 0 2019-12-11T17:55:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.937+0000 7fbbe9ffb700 20 reqs_thread_entry: start 2019-12-11T17:55:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.937+0000 7fbcc57aeec0 20 get_system_obj_state: rctx=0x7ffd6eccc738 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55e44f242d80 s->prefetch_data=0 2019-12-11T17:55:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.937+0000 7fbcc57aeec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-11T17:55:11.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-11T17:55:11.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:11.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T17:55:11.958 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T17:55:11.959 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T17:55:11.959 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.952+0000 7fbcc57aeec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:11.970 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.965+0000 7fbcc57aeec0 20 rados_obj.operate() r=0 bl.length=465 2019-12-11T17:55:11.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.965+0000 7fbcc57aeec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-11T17:55:11.971 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.965+0000 7fbcc57aeec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:11.984 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.979+0000 7fbcc57aeec0 10 removing key index: PGPNDFAJVZVQYZBMSUSU 2019-12-11T17:55:11.985 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:11.979+0000 7fbcc57aeec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-12-11T17:55:12.006 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.001+0000 7fbc93fff700 10 RGWWatcher::handle_notify() notify_id 566935683117 cookie 94439068036464 notifier 4649 bl.length()=170 2019-12-11T17:55:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.112+0000 7fbcc57aeec0 10 removing email index: bar.client.0+test@test.test 2019-12-11T17:55:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.112+0000 7fbcc57aeec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-12-11T17:55:12.129 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.124+0000 7fbc93fff700 10 RGWWatcher::handle_notify() notify_id 566935683123 cookie 94439068030496 notifier 4649 bl.length()=178 2019-12-11T17:55:12.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.967+0000 7fbcc57aeec0 10 removing user buckets index 2019-12-11T17:55:12.973 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.967+0000 7fbcc57aeec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-12-11T17:55:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:12.980+0000 7fbc93fff700 10 RGWWatcher::handle_notify() notify_id 566935684056 cookie 94439068034320 notifier 4649 bl.length()=169 2019-12-11T17:55:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.256+0000 7fbcc57aeec0 10 removing user index: bar.client.0 2019-12-11T17:55:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.256+0000 7fbcc57aeec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-12-11T17:55:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.256+0000 7fbcc57aeec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-12-11T17:55:13.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.276+0000 7fbc93fff700 10 RGWWatcher::handle_notify() notify_id 566935683124 cookie 94439068030496 notifier 4649 bl.length()=161 2019-12-11T17:55:13.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.642+0000 7fbcc57aeec0 20 remove_watcher() i=0 2019-12-11T17:55:13.648 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.642+0000 7fbcc57aeec0 2 removed watcher, disabling cache 2019-12-11T17:55:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.681+0000 7fbcc57aeec0 20 remove_watcher() i=1 2019-12-11T17:55:13.718 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.713+0000 7fbcc57aeec0 20 remove_watcher() i=2 2019-12-11T17:55:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.761+0000 7fbcc57aeec0 20 remove_watcher() i=3 2019-12-11T17:55:13.811 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.806+0000 7fbcc57aeec0 20 remove_watcher() i=4 2019-12-11T17:55:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.878+0000 7fbcc57aeec0 20 remove_watcher() i=5 2019-12-11T17:55:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.944+0000 7fbcc57aeec0 20 remove_watcher() i=6 2019-12-11T17:55:13.989 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:13.983+0000 7fbcc57aeec0 20 remove_watcher() i=7 2019-12-11T17:55:13.998 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-12-11T17:55:14.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.137+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.163+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.164+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.176+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.176+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.181+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.181+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.194 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.189+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:14.372 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.367+0000 7f6fd4654ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T17:55:14.373 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.367+0000 7f6fd4654ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T17:55:14.373 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.367+0000 7f6fd4654ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T17:55:14.373 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.367+0000 7f6fd4654ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T17:55:14.373 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.367+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.386 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.381+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:14.387 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.381+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.399+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:14.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.399+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.408+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:14.413 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.408+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.418+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.418+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.428 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.423+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.428 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.423+0000 7f6fd4654ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T17:55:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.423+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.429+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.434 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.429+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.437+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:14.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.438+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.446+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:14.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.446+0000 7f6fd4654ec0 20 zonegroup default 2019-12-11T17:55:14.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.446+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.451+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.451+0000 7f6fd4654ec0 10 Cannot find current period zone using local zone 2019-12-11T17:55:14.456 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.451+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.455+0000 7f6fd4654ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:14.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.455+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.463+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.463+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:14.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.484+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:14.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.484+0000 7f6fd4654ec0 20 zone default found 2019-12-11T17:55:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.484+0000 7f6fd4654ec0 20 started sync module instance, tier type = 2019-12-11T17:55:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.484+0000 7f6fd4654ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T17:55:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=0 2019-12-11T17:55:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=1 2019-12-11T17:55:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=2 2019-12-11T17:55:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=3 2019-12-11T17:55:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=4 2019-12-11T17:55:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.863+0000 7f6fd4654ec0 20 add_watcher() i=5 2019-12-11T17:55:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.890+0000 7f6fd4654ec0 20 add_watcher() i=6 2019-12-11T17:55:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.898+0000 7f6fd4654ec0 20 add_watcher() i=7 2019-12-11T17:55:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.898+0000 7f6fd4654ec0 2 all 8 watchers are set, enabling cache 2019-12-11T17:55:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.898+0000 7f6f927dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T17:55:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.899+0000 7f6fc187e700 0 -- >> v2:172.21.15.150:3300/0 conn(0x5618cdefeb60 msgr2=0x5618cdf00fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T17:55:14.948 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:14.942+0000 7f6fc107d700 0 -- 172.21.15.73:0/2673104743 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x5618cdf13b90 msgr2=0x5618cdf15fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T17:55:16.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.456+0000 7f6f08ff9700 20 reqs_thread_entry: start 2019-12-11T17:55:16.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.456+0000 7f6f027fc700 20 reqs_thread_entry: start 2019-12-11T17:55:16.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.456+0000 7f6fd4654ec0 20 init_complete bucket index max shards: 0 2019-12-11T17:55:16.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.456+0000 7f6f00ff9700 20 reqs_thread_entry: start 2019-12-11T17:55:16.462 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.456+0000 7f6fd4654ec0 20 get_system_obj_state: rctx=0x7ffface32518 obj=default.rgw.meta:users.uid:foo.client.0 state=0x5618cdf80600 s->prefetch_data=0 2019-12-11T17:55:16.463 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.457+0000 7f6fd4654ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T17:55:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.469+0000 7f6fd4654ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.484+0000 7f6fd4654ec0 20 rados_obj.operate() r=0 bl.length=465 2019-12-11T17:55:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.484+0000 7f6fd4654ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-11T17:55:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.484+0000 7f6fd4654ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:16.506 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.500+0000 7f6fd4654ec0 10 removing key index: IPEFVTOIYNACNNPHUSTO 2019-12-11T17:55:16.506 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.500+0000 7f6fd4654ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-12-11T17:55:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.511+0000 7f6fa2ffd700 10 RGWWatcher::handle_notify() notify_id 566935683118 cookie 94664534158304 notifier 4655 bl.length()=170 2019-12-11T17:55:16.705 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.700+0000 7f6fd4654ec0 10 removing email index: foo.client.0+test@test.test 2019-12-11T17:55:16.705 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.700+0000 7f6fd4654ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-12-11T17:55:16.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:16.711+0000 7f6fa2ffd700 10 RGWWatcher::handle_notify() notify_id 566935683232 cookie 94664534191808 notifier 4655 bl.length()=178 2019-12-11T17:55:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.260+0000 7f6fd4654ec0 10 removing user buckets index 2019-12-11T17:55:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.260+0000 7f6fd4654ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-12-11T17:55:17.281 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.275+0000 7f6fa2ffd700 10 RGWWatcher::handle_notify() notify_id 566935683125 cookie 94664534151552 notifier 4655 bl.length()=169 2019-12-11T17:55:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.435+0000 7f6fd4654ec0 10 removing user index: foo.client.0 2019-12-11T17:55:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.435+0000 7f6fd4654ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-12-11T17:55:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.435+0000 7f6fd4654ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-12-11T17:55:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.455+0000 7f6fa2ffd700 10 RGWWatcher::handle_notify() notify_id 566935683107 cookie 94664534149584 notifier 4655 bl.length()=161 2019-12-11T17:55:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.657+0000 7f6fd4654ec0 20 remove_watcher() i=0 2019-12-11T17:55:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.657+0000 7f6fd4654ec0 2 removed watcher, disabling cache 2019-12-11T17:55:17.706 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.701+0000 7f6fd4654ec0 20 remove_watcher() i=1 2019-12-11T17:55:17.761 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.756+0000 7f6fd4654ec0 20 remove_watcher() i=2 2019-12-11T17:55:17.801 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.796+0000 7f6fd4654ec0 20 remove_watcher() i=3 2019-12-11T17:55:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.841+0000 7f6fd4654ec0 20 remove_watcher() i=4 2019-12-11T17:55:17.887 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.881+0000 7f6fd4654ec0 20 remove_watcher() i=5 2019-12-11T17:55:17.936 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.930+0000 7f6fd4654ec0 20 remove_watcher() i=6 2019-12-11T17:55:17.983 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:17.977+0000 7f6fd4654ec0 20 remove_watcher() i=7 2019-12-11T17:55:17.990 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-12-11T17:55:18.124 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.119+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.146+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.151 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.146+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.154+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.154+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.158+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.163 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.158+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.171 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.166+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.329+0000 7fed23a7dec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T17:55:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.329+0000 7fed23a7dec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T17:55:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.329+0000 7fed23a7dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T17:55:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.329+0000 7fed23a7dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T17:55:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.329+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.340+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.340+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.366+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.366+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.378+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.378+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.400+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:18.405 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.400+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.406+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.406+0000 7fed23a7dec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T17:55:18.411 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.406+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.411+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.416 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.411+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.423 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.418+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:18.424 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.418+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.425+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:18.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.425+0000 7fed23a7dec0 20 zonegroup default 2019-12-11T17:55:18.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.425+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.435 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.430+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.435 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.430+0000 7fed23a7dec0 10 Cannot find current period zone using local zone 2019-12-11T17:55:18.435 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.430+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.434+0000 7fed23a7dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.434+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.441+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:18.447 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.441+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:18.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.455+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:18.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.455+0000 7fed23a7dec0 20 zone default found 2019-12-11T17:55:18.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.455+0000 7fed23a7dec0 20 started sync module instance, tier type = 2019-12-11T17:55:18.461 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.455+0000 7fed23a7dec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T17:55:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=0 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=1 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=2 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=3 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=4 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=5 2019-12-11T17:55:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.852+0000 7fed23a7dec0 20 add_watcher() i=6 2019-12-11T17:55:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.883+0000 7fed23a7dec0 20 add_watcher() i=7 2019-12-11T17:55:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.883+0000 7fed23a7dec0 2 all 8 watchers are set, enabling cache 2019-12-11T17:55:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.883+0000 7fec63fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T17:55:18.896 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.890+0000 7fed0bfff700 0 -- 172.21.15.73:0/1729183134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564d1c015d60 msgr2=0x564d1c018270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T17:55:18.923 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:18.917+0000 7fed114a8700 0 -- 172.21.15.73:0/1789866094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec50002790 msgr2=0x7fec50004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T17:55:20.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.439+0000 7fec4e7fc700 20 reqs_thread_entry: start 2019-12-11T17:55:20.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.439+0000 7fec47fff700 20 reqs_thread_entry: start 2019-12-11T17:55:20.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.439+0000 7fed23a7dec0 20 init_complete bucket index max shards: 0 2019-12-11T17:55:20.451 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.440+0000 7fec467fc700 20 reqs_thread_entry: start 2019-12-11T17:55:20.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.440+0000 7fed23a7dec0 20 get_system_obj_state: rctx=0x7ffc07b73a18 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x564d1c089290 s->prefetch_data=0 2019-12-11T17:55:20.452 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.440+0000 7fed23a7dec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-11T17:55:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-11T17:55:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T17:55:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-11T17:55:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 10 updating xattr: name=user.rgw.user-policy bl.length()=118 2019-12-11T17:55:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-11T17:55:20.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-11T17:55:20.466 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.452+0000 7fed23a7dec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:20.476 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.465+0000 7fed23a7dec0 20 rados_obj.operate() r=0 bl.length=524 2019-12-11T17:55:20.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.465+0000 7fed23a7dec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-11T17:55:20.477 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.465+0000 7fed23a7dec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-11T17:55:20.487 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.476+0000 7fed23a7dec0 10 removing key index: WSKDJRCTJGDGQCDHEYQK 2019-12-11T17:55:20.487 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.476+0000 7fed23a7dec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2019-12-11T17:55:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.483+0000 7fed01ffb700 10 RGWWatcher::handle_notify() notify_id 566935683192 cookie 94889182218144 notifier 4664 bl.length()=170 2019-12-11T17:55:20.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.691+0000 7fed23a7dec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-12-11T17:55:20.699 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.691+0000 7fed23a7dec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-12-11T17:55:20.710 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:20.704+0000 7fed01ffb700 10 RGWWatcher::handle_notify() notify_id 566935683233 cookie 94889182223872 notifier 4664 bl.length()=193 2019-12-11T17:55:21.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.386+0000 7fed23a7dec0 10 removing user buckets index 2019-12-11T17:55:21.391 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.386+0000 7fed23a7dec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-12-11T17:55:21.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.413+0000 7fed01ffb700 10 RGWWatcher::handle_notify() notify_id 566935683234 cookie 94889182236944 notifier 4664 bl.length()=184 2019-12-11T17:55:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.873+0000 7fed23a7dec0 10 removing user index: testx$tenanteduser.client.0 2019-12-11T17:55:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.873+0000 7fed23a7dec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-12-11T17:55:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.873+0000 7fed23a7dec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-12-11T17:55:21.888 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:21.883+0000 7fed01ffb700 10 RGWWatcher::handle_notify() notify_id 566935684057 cookie 94889182220224 notifier 4664 bl.length()=176 2019-12-11T17:55:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.056+0000 7fed23a7dec0 20 remove_watcher() i=0 2019-12-11T17:55:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.056+0000 7fed23a7dec0 2 removed watcher, disabling cache 2019-12-11T17:55:22.107 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.102+0000 7fed23a7dec0 20 remove_watcher() i=1 2019-12-11T17:55:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.139+0000 7fed23a7dec0 20 remove_watcher() i=2 2019-12-11T17:55:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.203+0000 7fed23a7dec0 20 remove_watcher() i=3 2019-12-11T17:55:22.284 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.278+0000 7fed23a7dec0 20 remove_watcher() i=4 2019-12-11T17:55:22.348 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.343+0000 7fed23a7dec0 20 remove_watcher() i=5 2019-12-11T17:55:22.443 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.437+0000 7fed23a7dec0 20 remove_watcher() i=6 2019-12-11T17:55:22.529 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:22.524+0000 7fed23a7dec0 20 remove_watcher() i=7 2019-12-11T17:55:22.540 INFO:tasks.s3tests:Removing s3-tests... 2019-12-11T17:55:22.540 INFO:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-12-11T17:55:22.720 INFO:teuthology.run_tasks:Running task swift... 2019-12-11T17:55:22.736 INFO:tasks.swift:clients=['client.0'] 2019-12-11T17:55:22.736 INFO:tasks.swift:Downloading swift... 2019-12-11T17:55:22.737 INFO:teuthology.orchestra.run.smithi073:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-12-11T17:55:22.847 INFO:teuthology.orchestra.run.smithi073.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-12-11T17:55:23.310 INFO:tasks.swift:Creating rgw users... 2019-12-11T17:55:23.310 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret wSztRZjx/U4oe80ag7C2THZWkXMN6s8hiIDt/OSQ2uBQypgZSepjXw== --email foo.client.0+test@test.test --key-type swift --access full 2019-12-11T17:55:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.440+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.478 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.473+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.473+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.481+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.487 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.481+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.486+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.492 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.486+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.501 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.496+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:23.675 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.670+0000 7f2ec699fec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T17:55:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.670+0000 7f2ec699fec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T17:55:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.670+0000 7f2ec699fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T17:55:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.670+0000 7f2ec699fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T17:55:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.670+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.678+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.678+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.691+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:23.697 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.691+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.699+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:23.704 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.699+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.711 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.706+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:23.712 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.706+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.711+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.711+0000 7f2ec699fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T17:55:23.716 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.711+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.720 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.714+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.720 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.714+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.723+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:23.729 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.723+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.734+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:23.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.734+0000 7f2ec699fec0 20 zonegroup default 2019-12-11T17:55:23.740 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.734+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.744 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.739+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.744 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.739+0000 7f2ec699fec0 10 Cannot find current period zone using local zone 2019-12-11T17:55:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.739+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.744+0000 7f2ec699fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.744+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.757 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.751+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:23.757 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.752+0000 7f2ec699fec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.763+0000 7f2ec699fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.763+0000 7f2ec699fec0 20 zone default found 2019-12-11T17:55:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.763+0000 7f2ec699fec0 20 started sync module instance, tier type = 2019-12-11T17:55:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:23.763+0000 7f2ec699fec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T17:55:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=0 2019-12-11T17:55:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=1 2019-12-11T17:55:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=2 2019-12-11T17:55:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=3 2019-12-11T17:55:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=4 2019-12-11T17:55:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.090+0000 7f2ec699fec0 20 add_watcher() i=5 2019-12-11T17:55:24.115 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.110+0000 7f2ec699fec0 20 add_watcher() i=6 2019-12-11T17:55:24.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.133+0000 7f2ec699fec0 20 add_watcher() i=7 2019-12-11T17:55:24.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.133+0000 7f2ec699fec0 2 all 8 watchers are set, enabling cache 2019-12-11T17:55:24.138 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.133+0000 7f2e07fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T17:55:24.143 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.138+0000 7f2eb3bc9700 0 -- 172.21.15.73:0/2513614993 >> v2:172.21.15.150:3300/0 conn(0x55869d308160 msgr2=0x55869d30a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-11T17:55:24.186 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:24.181+0000 7f2eb33c8700 0 -- 172.21.15.73:0/2042244037 >> [v2:172.21.15.73:6826/10520,v1:172.21.15.73:6827/10520] conn(0x55869d31e410 msgr2=0x55869d320830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2df27fc700 20 reqs_thread_entry: start 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2debfff700 20 reqs_thread_entry: start 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2ec699fec0 20 init_complete bucket index max shards: 0 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2dea7fc700 20 reqs_thread_entry: start 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2ec699fec0 20 get_system_obj_state: rctx=0x7ffca98ca748 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55869d38af40 s->prefetch_data=0 2019-12-11T17:55:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.034+0000 7f2ec699fec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-11T17:55:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.046+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-11T17:55:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.046+0000 7f2ec699fec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:26.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.046+0000 7f2ec699fec0 20 get_system_obj_state: rctx=0x7ffca98ca758 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55869d38ccd0 s->prefetch_data=0 2019-12-11T17:55:26.052 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.046+0000 7f2ec699fec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-11T17:55:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.051+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-11T17:55:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.051+0000 7f2ec699fec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T17:55:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.051+0000 7f2ec699fec0 20 get_system_obj_state: rctx=0x7ffca98ca368 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55869d38ccd0 s->prefetch_data=0 2019-12-11T17:55:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.051+0000 7f2ec699fec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-12-11T17:55:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.057+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-11T17:55:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.057+0000 7f2ec699fec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-11T17:55:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.057+0000 7f2ec699fec0 20 get_system_obj_state: rctx=0x7ffca98ca4e8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55869d38cf80 s->prefetch_data=0 2019-12-11T17:55:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.057+0000 7f2ec699fec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-12-11T17:55:26.066 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.061+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-11T17:55:26.066 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.061+0000 7f2ec699fec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-11T17:55:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.142+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T17:55:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.142+0000 7f2ec699fec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.142+0000 7f2ec699fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-12-11T17:55:26.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.159+0000 7f2ea97fa700 10 RGWWatcher::handle_notify() notify_id 566935683108 cookie 94036651073520 notifier 4676 bl.length()=612 2019-12-11T17:55:26.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.159+0000 7f2ea97fa700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T17:55:26.165 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.159+0000 7f2ea97fa700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:26.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.504+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-11T17:55:26.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.504+0000 7f2ec699fec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T17:55:26.510 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.504+0000 7f2ec699fec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-11T17:55:26.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.522+0000 7f2ea97fa700 10 RGWWatcher::handle_notify() notify_id 566935683235 cookie 94036651101616 notifier 4676 bl.length()=194 2019-12-11T17:55:26.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.522+0000 7f2ea97fa700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-11T17:55:26.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.522+0000 7f2ea97fa700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-11T17:55:26.823 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.818+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-11T17:55:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.818+0000 7f2ec699fec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-11T17:55:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.818+0000 7f2ec699fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-12-11T17:55:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.826+0000 7f2ea97fa700 10 RGWWatcher::handle_notify() notify_id 566935683126 cookie 94036651075488 notifier 4676 bl.length()=183 2019-12-11T17:55:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.826+0000 7f2ea97fa700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-11T17:55:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:26.826+0000 7f2ea97fa700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-11T17:55:27.071 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.066+0000 7f2ec699fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T17:55:27.071 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.066+0000 7f2ec699fec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:27.071 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.066+0000 7f2ec699fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-12-11T17:55:27.088 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.083+0000 7f2ea97fa700 10 RGWWatcher::handle_notify() notify_id 566935683109 cookie 94036651073520 notifier 4676 bl.length()=636 2019-12-11T17:55:27.088 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.083+0000 7f2ea97fa700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-11T17:55:27.089 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.083+0000 7f2ea97fa700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-11T17:55:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T17:55:27.420 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "foo.client.0", 2019-12-11T17:55:27.420 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. foo.client.0 foo", 2019-12-11T17:55:27.420 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "foo.client.0+test@test.test", 2019-12-11T17:55:27.420 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [ 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: "id": "foo.client.0:foo", 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: "permissions": "full-control" 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T17:55:27.421 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [], 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [ 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "foo.client.0:foo", 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "wSztRZjx/U4oe80ag7C2THZWkXMN6s8hiIDt/OSQ2uBQypgZSepjXw==" 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T17:55:27.422 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T17:55:27.423 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T17:55:27.424 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T17:55:27.425 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T17:55:27.426 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T17:55:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T17:55:27.426 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T17:55:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.486+0000 7f2ec699fec0 20 remove_watcher() i=0 2019-12-11T17:55:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.486+0000 7f2ec699fec0 2 removed watcher, disabling cache 2019-12-11T17:55:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.523+0000 7f2ec699fec0 20 remove_watcher() i=1 2019-12-11T17:55:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.575+0000 7f2ec699fec0 20 remove_watcher() i=2 2019-12-11T17:55:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.648+0000 7f2ec699fec0 20 remove_watcher() i=3 2019-12-11T17:55:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.697+0000 7f2ec699fec0 20 remove_watcher() i=4 2019-12-11T17:55:27.754 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.749+0000 7f2ec699fec0 20 remove_watcher() i=5 2019-12-11T17:55:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.800+0000 7f2ec699fec0 20 remove_watcher() i=6 2019-12-11T17:55:27.879 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:27.874+0000 7f2ec699fec0 20 remove_watcher() i=7 2019-12-11T17:55:27.888 INFO:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret 2SKqQmJ6qOQhKF7TlUnT5tD5boc6uMztYWLNMQdwWk1se+OfaN/VDw== --email bar.client.0+test@test.test --key-type swift --access full 2019-12-11T17:55:28.009 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.004+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.024+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.030 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.024+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.142 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.137+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.142 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.137+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.182+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.188 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.182+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.198 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.193+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.361+0000 7fcf34cb9ec0 20 RGWRados::pool_iterate: got zone_info.bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 2019-12-11T17:55:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.361+0000 7fcf34cb9ec0 20 RGWRados::pool_iterate: got zonegroup_info.d4496b90-2526-4c27-b94d-37bddcdd20bc 2019-12-11T17:55:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.361+0000 7fcf34cb9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-11T17:55:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.361+0000 7fcf34cb9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-11T17:55:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.361+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.370+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:28.376 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.370+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.384+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.384+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.391+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:28.396 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.391+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.403 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.398+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:28.404 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.398+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.403+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.403+0000 7fcf34cb9ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-11T17:55:28.409 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.403+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.407+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.412 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.407+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.414+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:28.420 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.414+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.421+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-11T17:55:28.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.421+0000 7fcf34cb9ec0 20 zonegroup default 2019-12-11T17:55:28.427 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.421+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.426+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.426+0000 7fcf34cb9ec0 10 Cannot find current period zone using local zone 2019-12-11T17:55:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.426+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.431+0000 7fcf34cb9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-11T17:55:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.431+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.443+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-11T17:55:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.444+0000 7fcf34cb9ec0 20 rados->read ofs=0 len=0 2019-12-11T17:55:28.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.454+0000 7fcf34cb9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-11T17:55:28.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.454+0000 7fcf34cb9ec0 20 zone default found 2019-12-11T17:55:28.459 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.454+0000 7fcf34cb9ec0 20 started sync module instance, tier type = 2019-12-11T17:55:28.460 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.454+0000 7fcf34cb9ec0 20 started zone id=bfff89ef-1bc6-413b-b5e1-9a5f50d7d7e2 (name=default) with tier type = 2019-12-11T17:55:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=0 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=1 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=2 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=3 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=4 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=5 2019-12-11T17:55:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.840+0000 7fcf34cb9ec0 20 add_watcher() i=6 2019-12-11T17:55:28.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.878+0000 7fcf34cb9ec0 20 add_watcher() i=7 2019-12-11T17:55:28.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.878+0000 7fcf34cb9ec0 2 all 8 watchers are set, enabling cache 2019-12-11T17:55:28.883 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.878+0000 7fcef27dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-11T17:55:28.899 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.893+0000 7fcf226e4700 0 -- 172.21.15.73:0/645575458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d4daa2930 msgr2=0x561d4daa2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-11T17:55:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:28.931+0000 7fcf226e4700 0 -- 172.21.15.73:0/258614925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d4daa8a50 msgr2=0x561d4daa8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-11T17:55:30.288 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.282+0000 7fce68ff9700 20 reqs_thread_entry: start 2019-12-11T17:55:30.288 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.283+0000 7fce627fc700 20 reqs_thread_entry: start 2019-12-11T17:55:30.288 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.283+0000 7fcf34cb9ec0 20 init_complete bucket index max shards: 0 2019-12-11T17:55:30.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.283+0000 7fce60ff9700 20 reqs_thread_entry: start 2019-12-11T17:55:30.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.283+0000 7fcf34cb9ec0 20 get_system_obj_state: rctx=0x7ffd10c3cf38 obj=default.rgw.meta:users.uid:bar.client.0 state=0x561d4db21100 s->prefetch_data=0 2019-12-11T17:55:30.289 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.283+0000 7fcf34cb9ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-11T17:55:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.294+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-11T17:55:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.294+0000 7fcf34cb9ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.294+0000 7fcf34cb9ec0 20 get_system_obj_state: rctx=0x7ffd10c3cf48 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x561d4db22e90 s->prefetch_data=0 2019-12-11T17:55:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.294+0000 7fcf34cb9ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-11T17:55:30.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.298+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-11T17:55:30.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.298+0000 7fcf34cb9ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T17:55:30.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.298+0000 7fcf34cb9ec0 20 get_system_obj_state: rctx=0x7ffd10c3cb58 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x561d4db22e90 s->prefetch_data=0 2019-12-11T17:55:30.304 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.298+0000 7fcf34cb9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-12-11T17:55:30.308 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.303+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-11T17:55:30.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.303+0000 7fcf34cb9ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-11T17:55:30.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.303+0000 7fcf34cb9ec0 20 get_system_obj_state: rctx=0x7ffd10c3ccd8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x561d4db23140 s->prefetch_data=0 2019-12-11T17:55:30.309 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.303+0000 7fcf34cb9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-12-11T17:55:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.312+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-11T17:55:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.312+0000 7fcf34cb9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-11T17:55:30.422 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.417+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T17:55:30.422 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.417+0000 7fcf34cb9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:30.422 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.417+0000 7fcf34cb9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-12-11T17:55:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.435+0000 7fcf02ffd700 10 RGWWatcher::handle_notify() notify_id 566935683127 cookie 94683856948096 notifier 4685 bl.length()=612 2019-12-11T17:55:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.435+0000 7fcf02ffd700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T17:55:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.435+0000 7fcf02ffd700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.771+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-11T17:55:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.771+0000 7fcf34cb9ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T17:55:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.771+0000 7fcf34cb9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-11T17:55:30.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.783+0000 7fcf02ffd700 10 RGWWatcher::handle_notify() notify_id 566935683128 cookie 94683856948096 notifier 4685 bl.length()=194 2019-12-11T17:55:30.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.783+0000 7fcf02ffd700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-11T17:55:30.789 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:30.783+0000 7fcf02ffd700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-11T17:55:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.156+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-11T17:55:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.156+0000 7fcf34cb9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-11T17:55:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.156+0000 7fcf34cb9ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-12-11T17:55:31.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.167+0000 7fcf02ffd700 10 RGWWatcher::handle_notify() notify_id 566935684058 cookie 94683856970512 notifier 4685 bl.length()=183 2019-12-11T17:55:31.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.167+0000 7fcf02ffd700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-11T17:55:31.173 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.167+0000 7fcf02ffd700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-11T17:55:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.349+0000 7fcf34cb9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T17:55:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.349+0000 7fcf34cb9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.349+0000 7fcf34cb9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-12-11T17:55:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.362+0000 7fcf02ffd700 10 RGWWatcher::handle_notify() notify_id 566935683129 cookie 94683856948096 notifier 4685 bl.length()=636 2019-12-11T17:55:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.362+0000 7fcf02ffd700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-11T17:55:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.362+0000 7fcf02ffd700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-11T17:55:31.512 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2019-12-11T17:55:31.512 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "bar.client.0", 2019-12-11T17:55:31.512 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. bar.client.0 bar", 2019-12-11T17:55:31.512 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "bar.client.0+test@test.test", 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [ 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: "id": "bar.client.0:bar", 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: "permissions": "full-control" 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T17:55:31.513 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [], 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [ 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "bar.client.0:bar", 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "2SKqQmJ6qOQhKF7TlUnT5tD5boc6uMztYWLNMQdwWk1se+OfaN/VDw==" 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: } 2019-12-11T17:55:31.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2019-12-11T17:55:31.515 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2019-12-11T17:55:31.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2019-12-11T17:55:31.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2019-12-11T17:55:31.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [] 2019-12-11T17:55:31.518 INFO:teuthology.orchestra.run.smithi073.stdout:} 2019-12-11T17:55:31.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T17:55:31.605 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.600+0000 7fcf34cb9ec0 20 remove_watcher() i=0 2019-12-11T17:55:31.606 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.600+0000 7fcf34cb9ec0 2 removed watcher, disabling cache 2019-12-11T17:55:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.672+0000 7fcf34cb9ec0 20 remove_watcher() i=1 2019-12-11T17:55:31.714 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.709+0000 7fcf34cb9ec0 20 remove_watcher() i=2 2019-12-11T17:55:31.799 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.794+0000 7fcf34cb9ec0 20 remove_watcher() i=3 2019-12-11T17:55:31.850 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.845+0000 7fcf34cb9ec0 20 remove_watcher() i=4 2019-12-11T17:55:31.896 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.891+0000 7fcf34cb9ec0 20 remove_watcher() i=5 2019-12-11T17:55:31.941 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.936+0000 7fcf34cb9ec0 20 remove_watcher() i=6 2019-12-11T17:55:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2019-12-11T17:55:31.975+0000 7fcf34cb9ec0 20 remove_watcher() i=7 2019-12-11T17:55:31.989 INFO:tasks.swift:Configuring testswift... 2019-12-11T17:55:31.990 INFO:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-12-11T17:55:34.358 INFO:teuthology.orchestra.run.smithi073.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-12-11T17:55:35.588 INFO:teuthology.orchestra.run.smithi073.stdout:Installing setuptools, pip, wheel...done. 2019-12-11T17:55:35.860 INFO:teuthology.orchestra.run.smithi073.stderr:Cache entry deserialization failed, entry ignored 2019-12-11T17:55:35.973 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting pip 2019-12-11T17:55:36.048 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-11T17:55:36.114 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: pip 2019-12-11T17:55:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: pip 9.0.1 2019-12-11T17:55:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling pip-9.0.1: 2019-12-11T17:55:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled pip-9.0.1 2019-12-11T17:55:36.799 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed pip-19.3.1 2019-12-11T17:55:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T17:55:37.599 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting setuptools==32.3.1 2019-12-11T17:55:37.602 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-11T17:55:37.642 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: setuptools 2019-12-11T17:55:37.643 INFO:teuthology.orchestra.run.smithi073.stdout: Found existing installation: setuptools 28.8.0 2019-12-11T17:55:37.659 INFO:teuthology.orchestra.run.smithi073.stdout: Uninstalling setuptools-28.8.0: 2019-12-11T17:55:37.669 INFO:teuthology.orchestra.run.smithi073.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-11T17:55:37.806 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed setuptools-32.3.1 2019-12-11T17:55:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-11T17:55:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-11T17:55:38.463 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting nose>=1.0.0 2019-12-11T17:55:38.465 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-11T17:55:38.561 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting boto>=2.0b4 2019-12-11T17:55:38.567 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-11T17:55:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-11T17:55:38.974 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting gevent>=0.14 2019-12-11T17:55:38.987 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T17:55:39.227 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting isodate>=0.4.4 2019-12-11T17:55:39.230 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-12-11T17:55:39.316 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting eventlet>=0.9.14 2019-12-11T17:55:39.365 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-12-11T17:55:39.566 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting netifaces>=0.5 2019-12-11T17:55:39.577 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T17:55:39.703 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting xattr<0.7.0,>=0.6 2019-12-11T17:55:39.714 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-12-11T17:55:40.134 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting simplejson>=2.1.3 2019-12-11T17:55:40.143 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-12-11T17:55:40.463 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting WebOb==1.0 2019-12-11T17:55:40.475 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-12-11T17:55:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-11T17:55:41.033 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-11T17:55:41.117 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting six 2019-12-11T17:55:41.119 INFO:teuthology.orchestra.run.smithi073.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-11T17:55:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting monotonic>=1.4 2019-12-11T17:55:41.190 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-12-11T17:55:41.275 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting dnspython>=1.15.0 2019-12-11T17:55:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-12-11T17:55:41.401 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting enum34; python_version < "3.4" 2019-12-11T17:55:41.411 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-12-11T17:55:41.449 INFO:teuthology.orchestra.run.smithi073.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-12-11T17:55:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for xattr (setup.py): started 2019-12-11T17:55:42.019 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-12-11T17:55:42.019 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24118 sha256=2d6c37432931378a5c3403fd7e7df45f9cf930a69bac50d4234f3cf3d919c530 2019-12-11T17:55:42.019 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-12-11T17:55:42.023 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for simplejson (setup.py): started 2019-12-11T17:55:43.120 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-12-11T17:55:43.121 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113105 sha256=8eb812abf5613802e97348062947607984180b1a006de043ae9b7a08aa528078 2019-12-11T17:55:43.121 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-12-11T17:55:43.138 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for WebOb (setup.py): started 2019-12-11T17:55:43.379 INFO:teuthology.orchestra.run.smithi073.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-12-11T17:55:43.379 INFO:teuthology.orchestra.run.smithi073.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=2587b2b86b03d42172ac660b0cabb7411a575401ae06034177428515256e3d48 2019-12-11T17:55:43.379 INFO:teuthology.orchestra.run.smithi073.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-12-11T17:55:43.386 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully built xattr simplejson WebOb 2019-12-11T17:55:43.431 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-12-11T17:55:45.151 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed PyYAML-5.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-12-11T17:55:45.418 INFO:teuthology.orchestra.run.smithi073.stdout:running develop 2019-12-11T17:55:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:running egg_info 2019-12-11T17:55:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:creating swift.egg-info 2019-12-11T17:55:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:writing swift.egg-info/PKG-INFO 2019-12-11T17:55:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-12-11T17:55:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-12-11T17:55:45.468 INFO:teuthology.orchestra.run.smithi073.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-12-11T17:55:45.469 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-11T17:55:45.472 INFO:teuthology.orchestra.run.smithi073.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-12-11T17:55:45.473 INFO:teuthology.orchestra.run.smithi073.stdout:reading manifest template 'MANIFEST.in' 2019-12-11T17:55:45.473 INFO:teuthology.orchestra.run.smithi073.stderr:warning: no files found matching 'ChangeLog' 2019-12-11T17:55:45.476 INFO:teuthology.orchestra.run.smithi073.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-11T17:55:45.478 INFO:teuthology.orchestra.run.smithi073.stdout:running build_ext 2019-12-11T17:55:45.478 INFO:teuthology.orchestra.run.smithi073.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-12-11T17:55:45.478 INFO:teuthology.orchestra.run.smithi073.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-12-11T17:55:45.495 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.496 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.498 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.499 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.500 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.500 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.501 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.502 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.503 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.504 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.504 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.506 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.507 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.508 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.509 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.510 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.511 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.512 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.512 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.513 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.514 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.518 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.519 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.527 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.528 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.531 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.533 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.537 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.539 INFO:teuthology.orchestra.run.smithi073.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-11T17:55:45.539 INFO:teuthology.orchestra.run.smithi073.stdout: 2019-12-11T17:55:45.539 INFO:teuthology.orchestra.run.smithi073.stdout:Installed /home/ubuntu/cephtest/swift 2019-12-11T17:55:45.541 INFO:teuthology.orchestra.run.smithi073.stdout:Processing dependencies for swift==1.4.4 2019-12-11T17:55:45.541 INFO:teuthology.orchestra.run.smithi073.stdout:Finished processing dependencies for swift==1.4.4 2019-12-11T17:55:45.559 INFO:teuthology.orchestra.run.smithi073:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-12-11T17:55:45.609 INFO:teuthology.orchestra.run.smithi073:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-12-11T17:56:11.759 INFO:teuthology.orchestra.run.smithi073.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-12-11T17:56:20.019 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-12-11T17:57:29.863 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:15:30.079 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:29.874 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:15:30.091 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:29.879 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:15:30.054 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:29.880 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:15:30.097 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:29.884 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:15:30.101 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:29.885 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:15:30.060 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:30.017 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:15:30.233 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:30.035 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:15:30.252 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T17:57:30.075 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:15:30.250 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:00:11.312 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-12-11T18:00:21.876 INFO:teuthology.orchestra.run.smithi073.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-12-11T18:00:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-12-11T18:00:35.851 INFO:teuthology.orchestra.run.smithi073.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-12-11T18:00:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-12-11T18:01:16.897 INFO:teuthology.orchestra.run.smithi073.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-12-11T18:01:17.200 INFO:teuthology.orchestra.run.smithi073.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-12-11T18:02:06.995 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:07.212 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.011 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:07.228 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.046 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:07.263 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.048 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:07.265 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.085 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:07.261 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.088 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:07.263 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.130 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:07.347 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.156 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:07.373 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:07.221 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:07.396 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.001 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:40.217 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.007 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:40.224 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.013 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:40.230 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.018 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:40.236 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.019 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:40.194 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.027 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:40.203 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.049 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:20:40.266 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.073 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:20:40.290 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:02:40.081 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:20:40.257 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:06:28.626 INFO:teuthology.orchestra.run.smithi073.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-12-11T18:06:29.983 INFO:teuthology.orchestra.run.smithi073.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-12-11T18:06:58.249 INFO:teuthology.orchestra.run.smithi073.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:07:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:07:52.126 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:25:52.343 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.130 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:25:52.347 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.145 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:25:52.362 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.150 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:25:52.367 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.160 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:25:52.335 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.169 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:25:52.344 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.317 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:25:52.533 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.333 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:25:52.550 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:07:52.456 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:25:52.631 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.205 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:26:28.422 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.211 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:26:28.428 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.303 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:26:28.520 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.324 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:26:28.541 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.326 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:26:28.501 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.331 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:26:28.548 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.335 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:26:28.510 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.370 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:26:28.587 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:08:28.405 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:26:28.580 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.638 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:28:28.855 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.661 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:28:28.878 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.671 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:28:28.888 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.684 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:28:28.858 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.685 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:28:28.860 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.693 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:28:28.910 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.732 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:28:28.948 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.751 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:28:28.967 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:10:28.752 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:28:28.926 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:11:12.151 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:11:25.490 INFO:teuthology.orchestra.run.smithi073.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:11:26.201 INFO:teuthology.orchestra.run.smithi073.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:11:37.923 INFO:teuthology.orchestra.run.smithi073.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:11:52.851 INFO:teuthology.orchestra.run.smithi073.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:13:02.299 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:31:02.516 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.310 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:31:02.526 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.313 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:31:02.530 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.318 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:31:02.534 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.324 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:31:02.499 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.353 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:31:02.528 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.417 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:31:02.633 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.419 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:31:02.636 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:02.529 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:31:02.704 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:13:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:13:12.105 INFO:teuthology.orchestra.run.smithi073.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-12-11T18:18:14.426 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:14.642 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.437 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:14.654 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.443 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:14.660 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.448 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:14.665 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.458 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:14.633 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.467 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:14.642 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.619 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:14.836 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.652 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:14.868 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:14.737 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:14.912 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.172 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:50.388 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.194 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:50.411 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.222 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:50.438 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.226 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:50.442 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.232 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:36:50.448 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.254 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:50.429 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.256 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:36:50.472 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.258 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:50.433 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:50.323 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:36:50.498 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:18:58.262 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:02.071 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:05.325 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:05.401 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:20.159 INFO:teuthology.orchestra.run.smithi073.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:29.699 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:34.187 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-12-11T18:19:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-11T18:20:42.677 INFO:teuthology.orchestra.run.smithi073.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-12-11T18:20:45.433 INFO:teuthology.orchestra.run.smithi073.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-12-11T18:20:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-12-11T18:21:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-12-11T18:21:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-12-11T18:22:17.304 INFO:teuthology.orchestra.run.smithi073.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-12-11T18:22:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-12-11T18:23:03.886 INFO:teuthology.orchestra.run.smithi073.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-12-11T18:23:25.930 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:41:26.146 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:25.941 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:41:26.158 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:25.947 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:41:26.164 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:25.951 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:41:26.167 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:25.956 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:41:26.131 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:25.962 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:41:26.137 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:26.116 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:41:26.333 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:26.129 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:41:26.304 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:23:26.136 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:41:26.353 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:26:33.049 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-12-11T18:26:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-12-11T18:26:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-12-11T18:27:11.754 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:45:11.970 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.755 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:45:11.972 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.794 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:45:12.010 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.802 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:45:12.018 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.826 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:45:12.001 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.829 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:45:12.004 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.849 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:45:12.066 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.932 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:45:12.107 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:27:11.941 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:45:12.157 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:17.785 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:18.536 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:20.505 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:22.009 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:32.210 INFO:teuthology.orchestra.run.smithi073.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:34.665 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:46:34.881 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.670 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:46:34.887 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.677 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:46:34.893 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.681 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:46:34.856 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.682 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:46:34.899 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.687 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:46:34.861 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.740 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:46:34.956 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.751 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:46:34.967 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:34.765 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:46:34.939 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:28:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:44.660 INFO:teuthology.orchestra.run.smithi073.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:28:50.638 INFO:teuthology.orchestra.run.smithi073.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:30:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:30:02.536 INFO:teuthology.orchestra.run.smithi073.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:30:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:30:22.219 INFO:teuthology.orchestra.run.smithi073.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:30:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:31:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:31:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:32:32.690 INFO:teuthology.orchestra.run.smithi073.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-11T18:33:47.066 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:51:47.282 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.073 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:51:47.289 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.083 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:51:47.299 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.086 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:51:47.302 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.091 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:51:47.266 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.104 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:51:47.279 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.256 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:51:47.472 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.282 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:51:47.498 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:33:47.310 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:51:47.484 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.152 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:53:33.368 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.179 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:53:33.395 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.185 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:53:33.401 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.186 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:53:33.402 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.191 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:53:33.366 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.193 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:53:33.367 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.244 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:53:33.460 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.248 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:53:33.465 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:33.250 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:53:33.425 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:35:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-12-11T18:35:38.292 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-12-11T18:35:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-12-11T18:35:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-12-11T18:36:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-12-11T18:36:33.822 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-12-11T18:36:38.333 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-12-11T18:36:39.217 INFO:teuthology.orchestra.run.smithi073.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-12-11T18:37:06.756 INFO:teuthology.orchestra.run.smithi073.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-12-11T18:37:06.847 INFO:teuthology.orchestra.run.smithi073.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-12-11T18:38:58.834 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:56:59.050 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.842 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:56:59.058 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.851 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:56:59.067 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.855 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:56:59.071 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.856 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:56:59.031 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.860 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:56:59.035 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.973 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:04:56:59.189 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:58.980 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:04:56:59.196 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:38:59.000 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:04:56:59.175 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.774 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:01:59.989 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.781 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:01:59.997 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.815 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:00.031 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.820 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:00.036 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.869 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:00.043 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.874 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:00.049 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.941 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:00.157 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:43:59.955 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:02:00.172 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:00.087 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:00.261 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.889 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:02:10.105 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.895 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:02:10.111 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.910 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:10.126 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.915 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:10.131 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.920 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:10.094 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.923 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:02:10.139 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.928 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:10.103 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.944 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:02:10.160 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:44:09.975 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:02:10.150 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:45:55.988 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:45:55.977+0000 1694f700 -1 osd.0 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:14.092042+0000 front 2019-12-11T18:45:15.929728+0000 (oldest deadline 2019-12-11T18:45:55.765107+0000) 2019-12-11T18:45:56.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:45:56.763+0000 1694f700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:12.235109+0000 front 2019-12-11T18:45:12.269833+0000 (oldest deadline 2019-12-11T18:45:56.254404+0000) 2019-12-11T18:45:56.955 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:45:56.948+0000 1694f700 -1 osd.0 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:14.092042+0000 front 2019-12-11T18:45:15.929728+0000 (oldest deadline 2019-12-11T18:45:55.765107+0000) 2019-12-11T18:45:57.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:45:57.112+0000 1694f700 -1 osd.1 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.821230+0000 front 2019-12-11T18:45:13.985602+0000 (oldest deadline 2019-12-11T18:45:56.472255+0000) 2019-12-11T18:45:57.254 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:45:57.242+0000 1694f700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.040550+0000 front 2019-12-11T18:45:12.875941+0000 (oldest deadline 2019-12-11T18:45:56.950941+0000) 2019-12-11T18:45:57.767 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:45:57.758+0000 1694f700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:12.235109+0000 front 2019-12-11T18:45:12.269833+0000 (oldest deadline 2019-12-11T18:45:56.254404+0000) 2019-12-11T18:45:57.958 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:45:57.942+0000 1694f700 -1 osd.0 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:14.092042+0000 front 2019-12-11T18:45:15.929728+0000 (oldest deadline 2019-12-11T18:45:55.765107+0000) 2019-12-11T18:45:58.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:45:58.113+0000 1694f700 -1 osd.1 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.821230+0000 front 2019-12-11T18:45:13.985602+0000 (oldest deadline 2019-12-11T18:45:56.472255+0000) 2019-12-11T18:45:58.244 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:45:58.234+0000 1694f700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.040550+0000 front 2019-12-11T18:45:12.875941+0000 (oldest deadline 2019-12-11T18:45:56.950941+0000) 2019-12-11T18:45:58.766 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:45:58.758+0000 1694f700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:12.235109+0000 front 2019-12-11T18:45:12.269833+0000 (oldest deadline 2019-12-11T18:45:56.254404+0000) 2019-12-11T18:45:58.963 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:45:58.956+0000 1694f700 -1 osd.0 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:14.092042+0000 front 2019-12-11T18:45:15.929728+0000 (oldest deadline 2019-12-11T18:45:55.765107+0000) 2019-12-11T18:45:59.036 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:45:59.021+0000 1694f700 -1 osd.6 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.107412+0000 front 2019-12-11T18:45:13.083483+0000 (oldest deadline 2019-12-11T18:45:58.360318+0000) 2019-12-11T18:45:59.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:45:59.154+0000 1694f700 -1 osd.1 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.821230+0000 front 2019-12-11T18:45:13.985602+0000 (oldest deadline 2019-12-11T18:45:56.472255+0000) 2019-12-11T18:45:59.210 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:45:59.201+0000 1694f700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.040550+0000 front 2019-12-11T18:45:12.875941+0000 (oldest deadline 2019-12-11T18:45:56.950941+0000) 2019-12-11T18:45:59.816 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:45:59.802+0000 1694f700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:12.235109+0000 front 2019-12-11T18:45:12.269833+0000 (oldest deadline 2019-12-11T18:45:56.254404+0000) 2019-12-11T18:45:59.938 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:45:59.931+0000 1694f700 -1 osd.0 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:14.092042+0000 front 2019-12-11T18:45:15.929728+0000 (oldest deadline 2019-12-11T18:45:55.765107+0000) 2019-12-11T18:46:00.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:46:00.153+0000 1694f700 -1 osd.1 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.821230+0000 front 2019-12-11T18:45:13.985602+0000 (oldest deadline 2019-12-11T18:45:56.472255+0000) 2019-12-11T18:46:00.169 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:46:00.160+0000 1694f700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:45:13.040550+0000 front 2019-12-11T18:45:12.875941+0000 (oldest deadline 2019-12-11T18:45:56.950941+0000) 2019-12-11T18:46:14.145 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:14.123+0000 32f89700 -1 osd.2 138 build_incremental_map_msg missing incremental map 138 2019-12-11T18:46:14.148 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:14.134+0000 31f87700 -1 osd.2 138 build_incremental_map_msg missing incremental map 138 2019-12-11T18:46:14.176 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:14.158+0000 35f8f700 -1 osd.2 138 build_incremental_map_msg missing incremental map 138 2019-12-11T18:46:14.965 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:14.906+0000 37f93700 -1 osd.2 138 build_incremental_map_msg missing incremental map 138 2019-12-11T18:46:47.007 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:46.999+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:48.054 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:48.047+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:49.047 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:49.040+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:50.087 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:50.080+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:51.095 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:51.088+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:52.120 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:52.112+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:53.158 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:53.151+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:54.125 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:54.117+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:55.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:55.146+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:55.624 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:04:55.840 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.631 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:04:55.847 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.675 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:04:55.849 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.677 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:04:55.894 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.698 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:04:55.914 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.708 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:04:55.883 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.766 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:04:55.982 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.839 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:04:56.055 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:55.891 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:04:56.066 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:46:56.132 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:56.125+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:57.063 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:46:57.056+0000 1694f700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.295791+0000 front 2019-12-11T18:46:12.054340+0000 (oldest deadline 2019-12-11T18:46:56.612965+0000) 2019-12-11T18:46:57.094 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:57.088+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:57.383 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:46:57.375+0000 1694f700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.344033+0000 front 2019-12-11T18:46:11.917685+0000 (oldest deadline 2019-12-11T18:46:57.043553+0000) 2019-12-11T18:46:57.883 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:46:57.866+0000 1694f700 -1 osd.4 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.311432+0000 front 2019-12-11T18:46:13.487204+0000 (oldest deadline 2019-12-11T18:46:57.263294+0000) 2019-12-11T18:46:58.061 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:46:58.054+0000 1694f700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.295791+0000 front 2019-12-11T18:46:12.054340+0000 (oldest deadline 2019-12-11T18:46:56.612965+0000) 2019-12-11T18:46:58.147 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:58.141+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:58.434 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:46:58.416+0000 1694f700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.344033+0000 front 2019-12-11T18:46:11.917685+0000 (oldest deadline 2019-12-11T18:46:57.043553+0000) 2019-12-11T18:46:58.740 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:46:58.733+0000 1694f700 -1 osd.3 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:14.799087+0000 front 2019-12-11T18:46:14.559110+0000 (oldest deadline 2019-12-11T18:46:58.632196+0000) 2019-12-11T18:46:58.859 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:46:58.852+0000 1694f700 -1 osd.4 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.311432+0000 front 2019-12-11T18:46:13.487204+0000 (oldest deadline 2019-12-11T18:46:57.263294+0000) 2019-12-11T18:46:59.106 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:46:59.099+0000 1694f700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.295791+0000 front 2019-12-11T18:46:12.054340+0000 (oldest deadline 2019-12-11T18:46:56.612965+0000) 2019-12-11T18:46:59.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:46:59.146+0000 1694f700 -1 osd.1 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.130327+0000 front 2019-12-11T18:46:13.319215+0000 (oldest deadline 2019-12-11T18:46:58.422804+0000) 2019-12-11T18:46:59.217 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:59.194+0000 1694f700 -1 osd.2 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:15.566430+0000 front 2019-12-11T18:46:15.375045+0000 (oldest deadline 2019-12-11T18:46:58.231095+0000) 2019-12-11T18:46:59.225 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:46:59.219+0000 1694f700 -1 osd.2 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:46:59.444 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:46:59.436+0000 1694f700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.344033+0000 front 2019-12-11T18:46:11.917685+0000 (oldest deadline 2019-12-11T18:46:57.043553+0000) 2019-12-11T18:46:59.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:46:59.764+0000 1694f700 -1 osd.3 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:14.799087+0000 front 2019-12-11T18:46:14.559110+0000 (oldest deadline 2019-12-11T18:46:58.632196+0000) 2019-12-11T18:46:59.856 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:46:59.847+0000 1694f700 -1 osd.4 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.311432+0000 front 2019-12-11T18:46:13.487204+0000 (oldest deadline 2019-12-11T18:46:57.263294+0000) 2019-12-11T18:47:00.109 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:47:00.103+0000 1694f700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.295791+0000 front 2019-12-11T18:46:12.054340+0000 (oldest deadline 2019-12-11T18:46:56.612965+0000) 2019-12-11T18:47:00.226 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:47:00.218+0000 1694f700 -1 osd.2 140 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e139) 2019-12-11T18:47:00.427 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:47:00.420+0000 1694f700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:46:13.344033+0000 front 2019-12-11T18:46:11.917685+0000 (oldest deadline 2019-12-11T18:46:57.043553+0000) 2019-12-11T18:48:20.988 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:20.870+0000 11caf700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:21.074 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:20.883+0000 3578e700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:21.108 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:20.894+0000 11caf700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:21.278 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:21.192+0000 38f95700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:21.339 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:21.328+0000 37792700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:21.366 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:48:21.351+0000 124b0700 -1 osd.7 145 build_incremental_map_msg missing incremental map 145 2019-12-11T18:48:31.086 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:06:31.302 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.091 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:06:31.308 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.103 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:06:31.319 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.107 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:06:31.324 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.116 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:06:31.291 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.135 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:06:31.310 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.202 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:06:31.418 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.211 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:06:31.427 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:48:31.319 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:06:31.494 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:49:17.264 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:49:17.249+0000 1694f700 -1 osd.7 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.305469+0000 front 2019-12-11T18:48:35.467146+0000 (oldest deadline 2019-12-11T18:49:16.948893+0000) 2019-12-11T18:49:17.958 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:49:17.949+0000 1694f700 -1 osd.5 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.058141+0000 front 2019-12-11T18:48:35.087480+0000 (oldest deadline 2019-12-11T18:49:17.317998+0000) 2019-12-11T18:49:18.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:49:18.242+0000 1694f700 -1 osd.1 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:36.648492+0000 front 2019-12-11T18:48:36.959446+0000 (oldest deadline 2019-12-11T18:49:18.007172+0000) 2019-12-11T18:49:18.277 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:49:18.268+0000 1694f700 -1 osd.7 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.305469+0000 front 2019-12-11T18:48:35.467146+0000 (oldest deadline 2019-12-11T18:49:16.948893+0000) 2019-12-11T18:49:18.478 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:49:18.470+0000 1694f700 -1 osd.3 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:32.238923+0000 front 2019-12-11T18:48:32.244626+0000 (oldest deadline 2019-12-11T18:49:17.505301+0000) 2019-12-11T18:49:18.960 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:49:18.950+0000 1694f700 -1 osd.0 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:36.959994+0000 front 2019-12-11T18:48:36.902937+0000 (oldest deadline 2019-12-11T18:49:18.799709+0000) 2019-12-11T18:49:19.000 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:49:18.991+0000 1694f700 -1 osd.5 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.058141+0000 front 2019-12-11T18:48:35.087480+0000 (oldest deadline 2019-12-11T18:49:17.317998+0000) 2019-12-11T18:49:19.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:49:19.226+0000 1694f700 -1 osd.1 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:36.648492+0000 front 2019-12-11T18:48:36.959446+0000 (oldest deadline 2019-12-11T18:49:18.007172+0000) 2019-12-11T18:49:19.255 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:49:19.247+0000 1694f700 -1 osd.7 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.305469+0000 front 2019-12-11T18:48:35.467146+0000 (oldest deadline 2019-12-11T18:49:16.948893+0000) 2019-12-11T18:49:19.343 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:49:19.335+0000 1694f700 -1 osd.4 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:33.924271+0000 front 2019-12-11T18:48:36.230830+0000 (oldest deadline 2019-12-11T18:49:18.500857+0000) 2019-12-11T18:49:19.460 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:49:19.451+0000 1694f700 -1 osd.3 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:32.238923+0000 front 2019-12-11T18:48:32.244626+0000 (oldest deadline 2019-12-11T18:49:17.505301+0000) 2019-12-11T18:49:19.955 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:49:19.947+0000 1694f700 -1 osd.0 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:36.959994+0000 front 2019-12-11T18:48:36.902937+0000 (oldest deadline 2019-12-11T18:49:18.799709+0000) 2019-12-11T18:49:20.025 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:49:20.016+0000 1694f700 -1 osd.5 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.058141+0000 front 2019-12-11T18:48:35.087480+0000 (oldest deadline 2019-12-11T18:49:17.317998+0000) 2019-12-11T18:49:20.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:49:20.207+0000 1694f700 -1 osd.1 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:36.648492+0000 front 2019-12-11T18:48:36.959446+0000 (oldest deadline 2019-12-11T18:49:18.007172+0000) 2019-12-11T18:49:20.233 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:49:20.213+0000 1694f700 -1 osd.7 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.305469+0000 front 2019-12-11T18:48:35.467146+0000 (oldest deadline 2019-12-11T18:49:16.948893+0000) 2019-12-11T18:49:20.357 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:49:20.348+0000 1694f700 -1 osd.4 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:33.924271+0000 front 2019-12-11T18:48:36.230830+0000 (oldest deadline 2019-12-11T18:49:18.500857+0000) 2019-12-11T18:49:20.514 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:49:20.506+0000 1694f700 -1 osd.3 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:32.238923+0000 front 2019-12-11T18:48:32.244626+0000 (oldest deadline 2019-12-11T18:49:17.505301+0000) 2019-12-11T18:49:20.692 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:49:20.678+0000 1694f700 -1 osd.6 145 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:48:35.319611+0000 front 2019-12-11T18:48:35.312927+0000 (oldest deadline 2019-12-11T18:49:19.997465+0000) 2019-12-11T18:50:17.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:17.252+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:17.456 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:17.449+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:17.979 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:17.970+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:18.010 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:18.003+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:18.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:18.240+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:18.482 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:18.475+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:18.958 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:18.951+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:19.013 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:19.005+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:19.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:19.231+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:19.474 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:19.467+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:19.915 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:19.908+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:20.020 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:20.012+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:20.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:20.275+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:20.506 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:20.483+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:20.954 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:20.947+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:21.063 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:21.049+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:21.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:21.269+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:21.543 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:50:21.536+0000 1694f700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.038507+0000 front 2019-12-11T18:49:37.157513+0000 (oldest deadline 2019-12-11T18:50:21.527346+0000) 2019-12-11T18:50:21.553 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:21.546+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:21.893 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:50:21.886+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.020520+0000 front 2019-12-11T18:49:37.235077+0000 (oldest deadline 2019-12-11T18:50:21.021602+0000) 2019-12-11T18:50:21.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:21.938+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:22.091 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:22.084+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:22.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:22.279+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:22.540 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:50:22.532+0000 1694f700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.038507+0000 front 2019-12-11T18:49:37.157513+0000 (oldest deadline 2019-12-11T18:50:21.527346+0000) 2019-12-11T18:50:22.541 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:22.533+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:22.925 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:22.918+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:22.926 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:50:22.919+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.020520+0000 front 2019-12-11T18:49:37.235077+0000 (oldest deadline 2019-12-11T18:50:21.021602+0000) 2019-12-11T18:50:23.095 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:23.087+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:23.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:23.240+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:23.554 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:23.547+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:23.573 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:50:23.566+0000 1694f700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.038507+0000 front 2019-12-11T18:49:37.157513+0000 (oldest deadline 2019-12-11T18:50:21.527346+0000) 2019-12-11T18:50:23.925 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:23.917+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:23.928 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:50:23.921+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.020520+0000 front 2019-12-11T18:49:37.235077+0000 (oldest deadline 2019-12-11T18:50:21.021602+0000) 2019-12-11T18:50:24.095 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:24.088+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:24.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:24.234+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:24.590 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:50:24.583+0000 1694f700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.038507+0000 front 2019-12-11T18:49:37.157513+0000 (oldest deadline 2019-12-11T18:50:21.527346+0000) 2019-12-11T18:50:24.663 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:50:24.586+0000 1694f700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.439137+0000 front 2019-12-11T18:49:36.937181+0000 (oldest deadline 2019-12-11T18:50:16.480204+0000) 2019-12-11T18:50:24.936 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:50:24.904+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.990538+0000 front 2019-12-11T18:49:37.174630+0000 (oldest deadline 2019-12-11T18:50:17.290184+0000) 2019-12-11T18:50:24.944 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:50:24.937+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.020520+0000 front 2019-12-11T18:49:37.235077+0000 (oldest deadline 2019-12-11T18:50:21.021602+0000) 2019-12-11T18:50:25.107 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:50:25.100+0000 1694f700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:34.385960+0000 front 2019-12-11T18:49:34.393732+0000 (oldest deadline 2019-12-11T18:50:17.773807+0000) 2019-12-11T18:50:25.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:50:25.279+0000 1694f700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:36.469551+0000 front 2019-12-11T18:49:36.939122+0000 (oldest deadline 2019-12-11T18:50:16.504251+0000) 2019-12-11T18:50:25.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:50:25.603+0000 1694f700 -1 osd.5 150 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:49:37.038507+0000 front 2019-12-11T18:49:37.157513+0000 (oldest deadline 2019-12-11T18:50:21.527346+0000) 2019-12-11T18:51:36.921 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:51:36.873+0000 35f8f700 -1 osd.7 155 build_incremental_map_msg missing incremental map 155 2019-12-11T18:51:36.964 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:51:36.940+0000 37f93700 -1 osd.7 155 build_incremental_map_msg missing incremental map 155 2019-12-11T18:51:37.247 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:51:37.118+0000 3578e700 -1 osd.7 155 build_incremental_map_msg missing incremental map 155 2019-12-11T18:51:43.548 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T18:51:43.525+0000 20e25700 -1 RGWWatcher::handle_error cookie 822007664 err (107) Transport endpoint is not connected 2019-12-11T18:51:44.293 INFO:tasks.rgw.client.0.smithi073.stdout:2019-12-11T18:51:44.265+0000 20e25700 -1 RGWWatcher::handle_error cookie 821806864 err (107) Transport endpoint is not connected 2019-12-11T18:52:21.764 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:21.980 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.796 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:22.012 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.822 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:22.039 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.825 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:22.041 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.850 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:22.023 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.856 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:22.030 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:21.956 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:22.171 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:22.082 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:22.298 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:22.082 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:22.257 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:37.620 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:37.612+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:37.821 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:37.813+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:38.640 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:38.633+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:38.690 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:38.682+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:38.778 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:38.770+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:39.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:39.645+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:39.721 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:39.711+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:39.740 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:39.731+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:40.278 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:40.269+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:40.285 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:40.276+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:40.702 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:40.693+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:40.712 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:40.703+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:40.768 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:40.759+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:41.287 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:41.278+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:41.311 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:41.297+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:41.437 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:41.653 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.447 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:41.663 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.461 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:41.677 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.462 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:41.637 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.464 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:41.680 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.470 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:41.645 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.487 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:10:41.703 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.511 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:10:41.727 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.518 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:10:41.692 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:52:41.706 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:41.697+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:41.737 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:41.728+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:41.755 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:41.747+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:42.302 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:42.294+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:42.327 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:42.318+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:42.720 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:42.710+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:42.726 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:42.718+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:42.756 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:42.747+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:42.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:42.881+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:43.284 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:43.275+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:43.320 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:43.312+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:43.683 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:43.676+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:43.740 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:43.734+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:43.783 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:43.774+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:43.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:43.916+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:44.299 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:44.290+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:44.334 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:44.326+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:44.685 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:44.677+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:44.705 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:44.697+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:44.809 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:44.798+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:44.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:44.920+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:45.337 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:45.328+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:45.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:45.362+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:45.655 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:45.648+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:45.693 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:45.685+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:45.833 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:45.824+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:45.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:45.936+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:46.333 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:46.324+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:46.352 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:46.341+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:46.616 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:46.608+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:46.661 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:46.651+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:46.842 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:46.833+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:46.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:46.903+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:47.318 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:47.309+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:47.352 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:47.343+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:47.657 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:47.650+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:47.702 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:47.695+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:47.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:47.858+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:47.885 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:47.877+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:48.283 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:48.275+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:48.318 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:48.309+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:48.630 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:48.622+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:48.745 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:48.738+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:48.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:48.898+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:48.940 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:48.931+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:49.281 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:49.272+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:49.285 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:49.276+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:49.679 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:49.671+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:49.722 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:49.715+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:49.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:49.854+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:49.960 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:49.951+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:50.296 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:50.287+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:50.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:50.320+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:50.714 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:50.708+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:50.736 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:50.727+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:50.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:50.899+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:50.926 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:50.918+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:51.301 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:52:51.293+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.897170+0000 front 2019-12-11T18:51:56.928755+0000 (oldest deadline 2019-12-11T18:52:39.967695+0000) 2019-12-11T18:52:51.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:51.363+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:51.675 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:51.667+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:51.738 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:52:51.729+0000 1694f700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.333301+0000 front 2019-12-11T18:51:56.700797+0000 (oldest deadline 2019-12-11T18:52:37.394291+0000) 2019-12-11T18:52:51.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:51.899+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:51.942 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:52:51.930+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.259464+0000 front 2019-12-11T18:51:53.271439+0000 (oldest deadline 2019-12-11T18:52:37.308522+0000) 2019-12-11T18:52:52.377 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:52.369+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:52:52.644 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:52:52.637+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:53.491802+0000 front 2019-12-11T18:51:53.888564+0000 (oldest deadline 2019-12-11T18:52:38.126354+0000) 2019-12-11T18:52:52.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:52:52.914+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.934927+0000 front 2019-12-11T18:51:56.812738+0000 (oldest deadline 2019-12-11T18:52:42.660024+0000) 2019-12-11T18:52:53.410 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:52:53.402+0000 1694f700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:51:56.584351+0000 front 2019-12-11T18:51:56.525142+0000 (oldest deadline 2019-12-11T18:52:39.899327+0000) 2019-12-11T18:53:49.138 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:49.129+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:49.779 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:49.770+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:49.853 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:49.845+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:50.128 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:50.121+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:50.742 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:50.734+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:50.873 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:50.864+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:51.088 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:51.081+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:51.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:51.282+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:51.746 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:51.737+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:51.875 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:51.865+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:52.021 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:52.013+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:52.103 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:52.096+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:52.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:52.239+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:52.249 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:52.240+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:52.795 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:52.787+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:52.852 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:52.844+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:53.051 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:53.044+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:53.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:53.093+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:53.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:53.239+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:53.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:53.283+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:53.772 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:53.763+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:53.901 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:53.892+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:54.052 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:54.044+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:54.129 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:54.122+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:54.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:54.198+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:54.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:54.238+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:54.731 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:54.723+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:54.951 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:54.943+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:55.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:54.999+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:55.120 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:55.113+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:55.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:55.222+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:55.300 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:55.291+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:55.691 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:55.682+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:55.928 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:55.919+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:56.061 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:56.054+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:56.165 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:56.158+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:56.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:56.264+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:56.336 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:56.326+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:56.724 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:56.715+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:56.940 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:56.931+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:57.064 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:57.057+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:57.199 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:57.193+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:57.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:57.250+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:57.298 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:57.289+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:57.778 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:57.769+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:57.931 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:57.923+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:58.070 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:58.063+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:58.200 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:58.193+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:58.286 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:58.277+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:58.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:58.281+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:58.794 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:58.786+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:58.894 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:58.885+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:59.039 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:59.031+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:53:59.166 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:53:59.159+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:53:59.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:53:59.272+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:53:59.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:53:59.310+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:53:59.798 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:53:59.789+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:53:59.902 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:53:59.894+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:53:59.999 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:53:59.991+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:00.206 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:00.198+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:00.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:00.272+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:00.287 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:00.276+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:00.824 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:00.816+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:00.937 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:00.928+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:01.033 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:01.025+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:01.249 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:01.242+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:01.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:01.243+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:01.324 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:01.315+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:01.797 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:01.788+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:01.949 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:01.940+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:02.085 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:02.078+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:02.211 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:02.204+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:02.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:02.255+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:02.283 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:02.274+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:02.849 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:02.841+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:02.983 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:02.974+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:03.059 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:03.052+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:03.225 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:03.216+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:03.240 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:03.230+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:03.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:03.243+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:03.893 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:03.885+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:03.973 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:03.965+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:04.094 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:04.086+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:04.182 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:04.174+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:04.195 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:04.187+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:04.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:04.292+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:04.902 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:04.891+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:04.957 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:04.949+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:05.119 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:05.112+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:05.208 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:05.201+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:05.242 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:05.235+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:05.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:05.286+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:05.943 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:05.935+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:05.973 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:05.965+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:06.148 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:06.141+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:06.175 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:06.169+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:06.255 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:06.247+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:06.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:06.322+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:06.925 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:06.917+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:06.958 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:06.951+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:07.143 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:07.135+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:07.169 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:07.161+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:07.239 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:07.232+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:07.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:07.333+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:07.911 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:07.904+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:07.959 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:07.951+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:08.141 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:08.132+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:08.146 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:08.137+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:08.203 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:08.195+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:08.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:08.359+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:08.934 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:08.926+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:08.974 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:08.966+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:09.112 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:09.105+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:09.135 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:09.127+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:09.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:09.232+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:09.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:09.402+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:09.964 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:09.956+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:09.974 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:09.966+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:10.092 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:10.084+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:10.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:10.131+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:10.297 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:10.289+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:10.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:10.373+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:10.971 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:10.963+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:11.042 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:10.977+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:11.118 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:11.111+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:11.168 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:11.161+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:11.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:11.265+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:11.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:54:11.335+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:06.454735+0000 front 2019-12-11T18:53:06.484156+0000 (oldest deadline 2019-12-11T18:53:51.099635+0000) 2019-12-11T18:54:11.988 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:54:11.980+0000 1694f700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.262025+0000 front 2019-12-11T18:53:04.968357+0000 (oldest deadline 2019-12-11T18:53:48.836058+0000) 2019-12-11T18:54:12.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:54:12.004+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.679825+0000 front 2019-12-11T18:53:06.496969+0000 (oldest deadline 2019-12-11T18:53:49.595217+0000) 2019-12-11T18:54:12.161 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:54:12.152+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:05.280962+0000 front 2019-12-11T18:53:05.679561+0000 (oldest deadline 2019-12-11T18:53:48.974207+0000) 2019-12-11T18:54:12.173 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:54:12.166+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.663084+0000 front 2019-12-11T18:53:08.631853+0000 (oldest deadline 2019-12-11T18:53:51.491156+0000) 2019-12-11T18:54:12.330 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:54:12.313+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:53:08.662639+0000 front 2019-12-11T18:53:09.331052+0000 (oldest deadline 2019-12-11T18:53:52.127124+0000) 2019-12-11T18:54:12.774 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:12.679+0000 1694f700 -1 osd.2 164 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:13.939 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:13.923+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:14.963 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:14.956+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:15.927 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:15.920+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:16.943 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:16.936+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:17.948 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:17.941+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:18.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:18.911+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:19.914 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:19.907+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:20.904 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:20.897+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:21.862 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:21.854+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:22.870 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:22.864+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:23.870 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:23.863+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:24.915 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:24.908+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:25.891 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:25.884+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:26.875 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:26.869+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:27.892 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:27.885+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:28.925 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:28.919+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:29.888 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:29.882+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:30.852 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:30.844+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:31.887 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:31.880+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:32.862 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:54:32.855+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4349.0:104229 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 5445999936 gen 2] snapc 0=[] ondisk+write+known_if_redirected e161) 2019-12-11T18:54:43.369 INFO:teuthology.orchestra.run.smithi073.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-12-11T18:54:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-12-11T18:55:09.551 INFO:teuthology.orchestra.run.smithi073.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-12-11T18:55:11.508 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:55:11.499+0000 124b0700 -1 osd.5 167 build_incremental_map_msg missing incremental map 167 2019-12-11T18:55:40.813 INFO:teuthology.orchestra.run.smithi073.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-12-11T18:55:41.823 INFO:teuthology.orchestra.run.smithi073.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-12-11T18:55:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:06.194 INFO:teuthology.orchestra.run.smithi073.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:06.852 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:09.535 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:09.528+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:09.609 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:09.601+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:10.533 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:10.525+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:10.626 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:10.617+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:10.978 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:10.971+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:11.280 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:11.270+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:11.416 INFO:teuthology.orchestra.run.smithi073.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:11.489 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:11.482+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:11.544 INFO:teuthology.orchestra.run.smithi073.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:11.651 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:11.641+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:11.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:11.969+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:11.980 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:11.971+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:12.244 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:12.234+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:12.492 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:12.478+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:12.529 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:12.519+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:12.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:12.601+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:12.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:12.951+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:13.006 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:12.998+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:13.204 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:13.195+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:13.494 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:13.483+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:13.551 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:13.544+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:13.636 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:13.629+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:13.733 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:13.725+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:13.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:13.968+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:14.028 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:14.020+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:14.217 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:14.209+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:14.523 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:14.516+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:14.538 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:14.530+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:14.656 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:14.647+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:14.700 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:14.691+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:14.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:14.941+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:15.033 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:15.025+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:15.267 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:15.257+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:15.512 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:15.504+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:15.516 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:15.506+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:15.637 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:15.628+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:15.699 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:15.688+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:15.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:15.931+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:16.022 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:16.014+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:16.310 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:16.301+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:16.486 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:16.477+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:16.542 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:16.535+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:16.676 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:16.666+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:16.678 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:16.668+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:16.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:16.931+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:17.073 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:17.066+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:17.268 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:17.258+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:17.461 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:17.451+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:17.542 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:17.534+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:17.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:17.668+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:17.677 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:17.668+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:17.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:17.928+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:18.041 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:18.033+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:18.266 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:18.257+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:18.493 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:18.483+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:18.555 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:18.547+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:18.655 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:18.646+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:18.727 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:18.715+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:18.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:18.890+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:19.054 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:19.046+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:19.274 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:19.264+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:19.499 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:19.488+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:19.576 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:19.568+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:19.639 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:19.629+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:19.748 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:19.738+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:19.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:19.876+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:20.054 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:20.046+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:20.306 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:20.296+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:20.526 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:20.516+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:20.628 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:20.620+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:20.659 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:20.648+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:20.729 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:20.720+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:20.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:20.919+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:21.104 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:21.095+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:21.308 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:21.291+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:21.557 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:21.548+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:21.637 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:21.628+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:21.681 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:21.671+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:21.726 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:21.716+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:21.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:21.888+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:22.068 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:22.061+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:22.329 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:22.319+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:22.556 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:22.547+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:22.645 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:22.635+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:22.646 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:22.639+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:22.769 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:22.759+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:22.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:22.953+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:23.100 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:23.093+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:23.299 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:23.290+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:23.526 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:23.516+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:23.689 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:23.679+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:23.690 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:23.683+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:23.772 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:23.763+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:23.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:23.953+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:24.084 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:24.077+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:24.341 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:24.332+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:24.487 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:24.477+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:24.680 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:24.671+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:24.707 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:24.699+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:24.734 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:24.723+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:24.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:24.918+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:25.133 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:25.125+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:25.386 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:25.376+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:25.485 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:25.475+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:25.689 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:25.681+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:25.696 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:25.686+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:25.753 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:25.743+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:25.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:25.907+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:26.113 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:26.106+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:26.393 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:26.384+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:26.472 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:26.461+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:26.673 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:26.663+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:26.698 INFO:teuthology.orchestra.run.smithi073.stderr:testFileCreate (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:26.701 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:26.694+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:26.757 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:26.746+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:26.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:26.891+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:27.109 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:27.101+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:27.374 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:27.365+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:27.451 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:27.442+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:27.720 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:14:27.936 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.724 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:27.716+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:27.728 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:14:27.945 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.737 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:27.729+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:27.742 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:14:27.959 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.746 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:14:27.962 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.751 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:14:27.925 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.760 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:14:27.935 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:27.775 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:27.767+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:testGetContentType (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:27.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:27.901+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:28.001 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:14:28.217 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:28.025 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:14:28.242 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:28.096 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:28.089+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:28.135 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:14:28.309 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T18:56:28.381 INFO:teuthology.orchestra.run.smithi073.stderr:testGetOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:28.383 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:28.375+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:28.460 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:28.452+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:28.696 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:28.689+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:28.707 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:28.699+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:28.776 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:28.767+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:28.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:28.946+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:29.079 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:29.072+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:testHead (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:29.412 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:29.404+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:29.428 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:29.420+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:29.672 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:29.665+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:29.714 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:29.705+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:29.788 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:29.779+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:29.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:29.914+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:30.077 INFO:teuthology.orchestra.run.smithi073.stderr:testHeadOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-12-11T18:56:30.099 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:30.091+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:30.377 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:30.368+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:30.390 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:30.381+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:30.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:30.672+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:30.699 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:30.690+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:30.755 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:30.746+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:30.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:30.929+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:31.059 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:31.051+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:31.342 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:31.333+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:31.418 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:31.410+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:31.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:31.653+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:31.666 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:31.658+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:31.730 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:31.721+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:31.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:56:31.919+0000 1694f700 -1 osd.1 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.431707+0000 front 2019-12-11T18:55:27.055172+0000 (oldest deadline 2019-12-11T18:56:11.719489+0000) 2019-12-11T18:56:32.085 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:32.077+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:32.304 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:56:32.295+0000 1694f700 -1 osd.7 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.617240+0000 front 2019-12-11T18:55:28.561518+0000 (oldest deadline 2019-12-11T18:56:10.819635+0000) 2019-12-11T18:56:32.475 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:56:32.465+0000 1694f700 -1 osd.4 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.969382+0000 front 2019-12-11T18:55:28.900284+0000 (oldest deadline 2019-12-11T18:56:11.628728+0000) 2019-12-11T18:56:32.668 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:56:32.660+0000 1694f700 -1 osd.3 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:27.637891+0000 front 2019-12-11T18:55:27.696915+0000 (oldest deadline 2019-12-11T18:56:09.316073+0000) 2019-12-11T18:56:32.696 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:56:32.687+0000 1694f700 -1 osd.5 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.263155+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:09.491658+0000) 2019-12-11T18:56:32.713 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:56:32.699+0000 1694f700 -1 osd.6 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:28.071053+0000 front 2019-12-11T18:55:28.083656+0000 (oldest deadline 2019-12-11T18:56:13.662533+0000) 2019-12-11T18:56:33.100 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:56:33.092+0000 1694f700 -1 osd.0 168 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:55:26.469196+0000 front 2019-12-11T18:55:26.467806+0000 (oldest deadline 2019-12-11T18:56:10.137129+0000) 2019-12-11T18:56:43.505 INFO:teuthology.orchestra.run.smithi073.stderr:testMetadataOnPost (test.functional.tests.TestFile) ... ok 2019-12-11T18:57:29.389 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:29.382+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:30.394 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:30.386+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:30.949 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:30.942+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:31.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:31.088+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:31.440 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:31.434+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:31.813 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:31.805+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:31.984 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:31.974+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:32.003 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:31.994+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:32.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:32.090+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:32.426 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:32.419+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:32.843 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:32.836+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:33.012 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:33.004+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:33.048 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:33.040+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:33.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:33.090+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:33.456 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:33.445+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:33.860 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:33.853+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:33.969 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:33.961+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:34.027 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:34.020+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:34.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:34.126+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:34.434 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:34.427+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:34.868 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:34.860+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:35.005 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:34.998+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:35.035 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:35.028+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:35.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:35.117+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:35.125 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:35.119+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:35.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:35.395+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:35.840 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:35.833+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:36.018 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:36.010+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:36.049 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:36.041+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:36.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:36.095+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:36.103 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:36.095+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:36.364 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:36.356+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:36.847 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:36.839+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:37.004 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:36.995+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:37.005 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:36.997+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:37.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:37.092+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:37.106 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:37.099+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:37.374 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:37.367+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:37.843 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:37.835+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:37.982 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:37.974+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:38.042 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:38.034+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:38.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:38.052+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:38.133 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:38.124+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:38.351 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:38.345+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:38.835 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:38.828+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:39.007 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:38.999+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:39.067 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:39.054+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:39.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:39.065+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:39.114 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:39.106+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:39.334 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:39.327+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:39.814 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:39.806+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:40.020 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:40.012+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:40.048 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:40.041+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:40.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:40.092+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:40.156 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:40.148+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:40.363 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:40.356+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:40.813 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:40.805+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:40.988 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:40.980+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:41.083 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:41.075+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:41.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:41.119+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:41.207 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:41.199+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:41.359 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:41.352+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:41.788 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:41.781+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:41.975 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:41.968+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:42.059 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:42.052+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:42.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:42.171+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:42.256 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:42.249+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:42.326 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:42.317+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:42.763 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:42.755+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:42.941 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:42.931+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:43.068 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:43.058+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:43.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:43.191+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:43.226 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:43.219+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:43.291 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:43.283+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:43.797 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:43.788+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:43.930 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:43.922+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:44.074 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:44.067+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:44.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:44.215+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:44.279 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:44.270+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:44.322 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:44.314+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:44.804 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:44.797+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:44.934 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:44.927+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:45.064 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:45.056+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:45.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:45.240+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:45.276 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:45.269+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:45.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:45.317+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:45.663 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:45.655+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:45.775 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:45.767+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:45.894 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:45.887+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:46.092 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:46.084+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:46.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:46.228+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:46.299 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:46.290+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:46.317 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:46.309+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:46.620 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:46.612+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:46.739 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:46.730+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:46.867 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:46.860+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:47.135 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:47.128+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:47.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:47.210+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:47.261 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:47.253+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:47.370 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:47.359+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:47.634 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:47.627+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:47.779 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:47.770+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:47.893 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:47.886+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:48.153 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:48.146+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:48.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:48.188+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:48.297 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:48.289+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:48.408 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:48.400+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:48.668 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:48.653+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:48.668 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:48.659+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:48.804 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:48.795+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:48.901 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:48.893+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:49.129 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:49.122+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:49.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:49.188+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:49.345 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:49.338+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:49.412 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:49.405+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:49.658 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:49.651+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:49.660 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:49.653+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:49.809 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:49.801+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:49.922 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:49.914+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:50.100 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:50.093+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:50.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:50.205+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:50.334 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:50.326+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:50.425 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:50.417+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:50.632 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:50.624+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:50.634 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:50.628+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:50.861 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:50.854+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:50.916 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:50.907+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:51.059 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:51.051+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:51.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:51.229+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:51.377 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:51.369+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:51.435 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:51.427+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:51.597 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:51.590+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:51.599 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:51.592+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:51.899 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:51.892+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:51.902 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:51.893+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:52.114 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:52.105+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:52.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:52.236+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:52.358 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:52.349+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:52.472 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:52.465+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:52.556 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:52.548+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:52.557 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:52.550+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:52.939 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:52.932+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:52.953 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:52.945+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:53.109 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:53.098+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:53.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:53.263+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:53.340 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:53.332+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:53.464 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:53.457+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:53.610 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:53.601+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:53.611 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:53.603+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:53.972 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:53.963+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:53.979 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:53.972+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:54.132 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:54.123+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:54.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:54.248+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:54.353 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:54.345+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:54.477 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:54.470+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:54.582 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:54.574+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:54.583 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:54.575+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:54.977 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:54.968+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:54.990 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:54.983+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:55.111 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:55.100+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:55.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:55.219+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:55.405 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:55.396+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:55.439 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:55.431+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:55.541 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:55.534+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:55.542 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:55.535+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:55.974 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:55.966+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:55.993 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:55.986+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:56.116 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:56.107+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:56.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:56.199+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:56.402 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:56.395+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:56.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:56.394+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:56.529 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:56.522+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:56.529 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:56.523+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:57.010 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:57.001+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:57.033 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:57.025+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:57.099 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:57.087+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:57.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:57.182+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:57.404 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:57.396+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:57.406 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:57.399+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:57.509 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:57.502+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:57.509 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:57.503+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:58.008 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:57.999+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:58.030 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:58.018+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:58.078 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:58.064+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:58.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:58.174+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:58.392 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:58.384+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:58.441 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:58.435+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:58.489 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:58.482+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:58.490 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:58.484+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:57:59.032 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:57:59.023+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:57:59.054 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:57:59.047+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:57:59.077 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:57:59.068+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:57:59.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:57:59.152+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:57:59.396 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:57:59.381+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:57:59.401 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:57:59.393+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:57:59.509 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:59.499+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:57:59.509 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:57:59.501+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:00.022 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:00.013+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:00.090 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:00.081+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:00.091 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:00.083+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:00.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:00.159+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:00.359 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:00.349+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:00.381 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:00.374+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:00.462 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:00.455+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:00.465 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:00.458+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:01.072 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:01.063+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:01.122 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:01.113+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:01.134 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:01.127+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:01.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:01.140+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:01.382 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:01.372+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:01.394 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:01.386+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:01.508 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:01.501+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:01.508 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:01.502+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:02.070 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:02.060+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:02.094 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:02.085+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:02.126 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:02.119+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:02.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:02.147+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:02.382 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:02.374+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:02.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:02.394+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:02.525 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:02.517+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:02.526 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:02.519+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:02.902 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T18:58:02.876+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e174 v174) 2019-12-11T18:58:03.081 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:03.074+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:03.113 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:03.105+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:03.141 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:03.135+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:03.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:03.165+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:03.353 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:03.345+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:03.454 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:03.445+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:03.479 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:03.472+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:03.481 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:03.475+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:04.042 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:04.034+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:04.129 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:04.120+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:04.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:04.151+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:04.170 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:04.163+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:04.354 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:04.346+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:04.448 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:04.440+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:04.487 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:04.480+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:04.490 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:04.483+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:05.000 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:04.992+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:05.132 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:05.124+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:05.151 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:05.144+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:05.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:05.164+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:05.397 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:05.390+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:05.404 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:05.396+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:05.476 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:05.468+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:05.477 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:05.470+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:05.969 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:05.961+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:06.105 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:06.098+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:06.173 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:06.165+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:06.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:06.188+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:06.376 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:06.368+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:06.436 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:06.429+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:06.504 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:06.497+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:06.506 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:06.499+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:06.947 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:06.939+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:07.148 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:07.141+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:07.149 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:07.142+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:07.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:07.152+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:07.406 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:07.399+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:07.421 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:07.414+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:07.529 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:07.522+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:07.531 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:07.525+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:07.906 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T18:58:07.897+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e174 v174) 2019-12-11T18:58:07.972 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:07.964+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:08.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:08.147+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:08.167 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:08.159+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:08.178 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:08.170+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:08.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:08.396+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:08.447 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:08.439+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:08.546 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:08.538+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:08.546 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:08.539+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:09.022 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:09.014+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:09.132 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:09.125+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:09.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:09.135+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:09.216 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:09.206+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:09.447 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:09.439+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:09.469 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:09.461+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:09.512 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:09.505+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:09.514 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:09.508+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:10.058 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:10.050+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:10.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:10.102+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:10.150 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:10.142+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:10.221 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:10.213+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:10.484 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:10.477+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:10.507 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:10.498+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:10.507 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:10.500+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:10.508 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:10.501+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:11.105 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:11.097+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:11.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:11.133+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:11.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:11.146+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:11.202 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:11.195+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:11.476 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:11.467+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:11.497 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:11.490+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:11.498 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:11.491+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:11.526 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:11.519+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:12.077 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:12.069+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:12.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:12.108+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:12.153 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:12.146+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:12.250 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:12.241+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:12.500 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:12.494+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:12.502 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:12.496+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:12.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:12.511+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:12.568 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:12.561+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:12.926 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T18:58:12.918+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e174 v174) 2019-12-11T18:58:13.085 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:13.076+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:13.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:13.130+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:13.154 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:13.147+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:13.283 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:13.276+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:13.461 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:13.454+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:13.463 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:13.457+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:13.535 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:13.526+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:13.545 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:13.538+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:14.094 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:14.082+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:14.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:14.155+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:14.192 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:14.185+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:14.267 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:14.260+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:14.436 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:14.428+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:14.437 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:14.430+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:14.493 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:14.486+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:14.568 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:14.560+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:15.086 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:15.078+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:15.152 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:15.145+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:15.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:15.166+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:15.231 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:15.224+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:15.409 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:15.400+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:15.409 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:15.402+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:15.464 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:15.450+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:15.604 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:15.597+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:16.044 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:16.036+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:16.156 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:16.148+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:16.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:16.197+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:16.264 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:16.256+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:16.390 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:16.382+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:16.391 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:16.383+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:16.492 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:16.484+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:16.635 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:16.625+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:17.039 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:17.031+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:17.142 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:17.135+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:17.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:17.159+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:17.270 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:17.262+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:17.426 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:17.420+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:17.428 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:17.422+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:17.515 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:17.508+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:17.616 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:17.608+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:17.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T18:58:17.933+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e174 v174) 2019-12-11T18:58:18.031 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:18.022+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:18.141 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:18.133+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:18.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:18.177+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:18.236 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:18.228+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:18.402 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:18.394+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:18.403 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:18.396+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:18.544 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:18.536+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:18.615 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:18.607+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:19.030 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:19.022+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:19.150 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:19.142+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:19.228 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:19.220+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:19.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:19.229+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:19.428 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:19.419+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:19.428 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:19.420+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:19.560 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:19.553+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:19.585 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:19.577+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:20.031 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:20.023+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:20.143 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:20.135+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:20.273 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:20.265+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:20.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:20.272+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:20.438 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:20.429+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:20.439 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:20.430+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:20.554 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:20.546+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:20.572 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:20.565+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:21.027 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:21.020+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:21.127 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:21.118+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:21.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:21.230+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:21.239 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:21.230+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:21.403 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:21.396+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:21.403 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:21.397+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:21.546 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:21.539+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:21.561 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:21.555+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:22.015 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:22.008+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:22.078 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:22.071+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:22.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:58:22.188+0000 1694f700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.202864+0000 front 2019-12-11T18:56:46.187129+0000 (oldest deadline 2019-12-11T18:57:30.708630+0000) 2019-12-11T18:58:22.266 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:22.258+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:22.368 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:22.361+0000 1694f700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T18:57:07.873077+0000 (oldest deadline 2019-12-11T18:57:47.873077+0000) 2019-12-11T18:58:22.369 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T18:58:22.362+0000 1694f700 -1 osd.2 174 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e172) 2019-12-11T18:58:22.541 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:58:22.533+0000 1694f700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:45.939458+0000 front 2019-12-11T18:56:45.927534+0000 (oldest deadline 2019-12-11T18:57:29.191862+0000) 2019-12-11T18:58:22.552 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:58:22.545+0000 1694f700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:50.206683+0000 front 2019-12-11T18:56:48.967781+0000 (oldest deadline 2019-12-11T18:57:34.750602+0000) 2019-12-11T18:58:23.023 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T18:58:23.003+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e174 v174) 2019-12-11T18:58:23.036 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:58:23.028+0000 1694f700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:46.397209+0000 front 2019-12-11T18:56:46.462496+0000 (oldest deadline 2019-12-11T18:57:31.859282+0000) 2019-12-11T18:58:23.129 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:58:23.122+0000 1694f700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:48.919790+0000 front 2019-12-11T18:56:49.842238+0000 (oldest deadline 2019-12-11T18:57:31.598772+0000) 2019-12-11T18:58:23.251 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:58:23.244+0000 1694f700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T18:56:49.790650+0000 front 2019-12-11T18:56:50.222083+0000 (oldest deadline 2019-12-11T18:57:30.471659+0000) 2019-12-11T18:58:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:testMetadataOnPut (test.functional.tests.TestFile) ... ok 2019-12-11T18:58:47.948 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:58:47.935+0000 21852700 -1 reset not still connected to 0x10198a20 2019-12-11T18:58:51.192 INFO:teuthology.orchestra.run.smithi073.stderr:testNameLimit (test.functional.tests.TestFile) ... ok 2019-12-11T18:58:51.236 INFO:teuthology.orchestra.run.smithi073.stderr:testNoContentLengthForPut (test.functional.tests.TestFile) ... ok 2019-12-11T18:58:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:testPostOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:05.521 INFO:teuthology.orchestra.run.smithi073.stderr:testRangedGets (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:17.349 INFO:teuthology.orchestra.run.smithi073.stderr:testSerialization (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:45.578 INFO:teuthology.orchestra.run.smithi073.stderr:testStackedOverwrite (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:testTooLongName (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:testZeroByteFile (test.functional.tests.TestFile) ... ok 2019-12-11T18:59:52.390 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:52.381+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:52.735 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:52.726+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:53.298 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:53.289+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:53.393 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:53.381+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:53.604 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:53.597+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:53.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:53.646+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:53.695 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:53.687+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:54.002 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:53.994+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:54.271 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:54.261+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:54.376 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:54.367+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:54.586 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:54.577+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:54.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:54.600+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:54.674 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:54.664+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:54.970 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:54.962+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:55.222 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:59:55.216+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T18:59:55.313 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:55.303+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:55.386 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:55.377+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:55.591 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:55.582+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:55.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:55.626+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:55.717 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:55.707+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:56.007 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:55.999+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:56.176 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:59:56.169+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T18:59:56.318 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:56.309+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:56.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:56.362+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:56.639 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:56.630+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:56.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:56.649+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:56.721 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:56.712+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:56.974 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:56.964+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:57.138 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:59:57.129+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T18:59:57.298 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:57.289+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:57.364 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:57.353+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:57.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:57.640+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:57.681 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:57.672+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:57.723 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:57.715+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:58.017 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:58.009+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:58.168 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:59:58.160+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T18:59:58.274 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:58.265+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:58.356 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:58.348+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:58.643 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:58.634+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:58.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:58.689+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:58.720 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:58.711+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T18:59:59.024 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T18:59:59.015+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T18:59:59.182 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T18:59:59.174+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T18:59:59.284 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T18:59:59.274+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T18:59:59.400 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T18:59:59.391+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T18:59:59.598 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T18:59:59.589+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T18:59:59.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T18:59:59.652+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T18:59:59.764 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T18:59:59.755+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:00.016 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:00.007+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:00.222 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:00.214+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:00.265 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:00.255+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:00.442 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:00.433+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:00.644 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:00.634+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:00.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:00.677+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:00.759 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:00.751+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:00.980 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:00.971+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:01.228 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:01.217+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:01.238 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:01.232+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:01.468 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:01.459+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:01.678 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:01.670+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:01.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:01.720+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:01.789 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:01.781+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:01.985 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:01.977+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:02.210 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:02.201+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:02.274 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:02.267+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:02.457 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:02.448+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:02.710 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:02.702+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:02.756 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:02.747+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:02.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:02.774+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:03.007 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:02.998+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:03.205 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:03.196+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:03.318 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:03.310+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:03.490 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:03.481+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:03.578 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:03.788 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.618 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:03.834 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.658 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:03.874 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.659 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:03.876 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.680 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:03.854 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.690 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:03.864 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.732 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:03.725+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:03.786 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:03.778+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:03.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:03.792+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:03.880 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:04.097 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.937 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:04.111 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:03.957 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:04.173 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:04.028 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:04.019+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:04.168 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:04.160+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:04.362 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:04.355+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:04.502 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:04.494+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:04.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:04.756+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:04.769 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:04.761+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:04.776 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:04.768+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:05.018 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:05.009+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:05.161 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:05.153+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:05.383 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:05.376+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:05.467 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:05.458+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:05.736 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:05.719+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:05.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:05.783+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:05.803 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:05.789+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:05.985 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:05.976+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:06.147 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:06.138+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:06.380 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:06.372+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:06.454 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:06.445+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:06.727 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:06.720+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:06.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:06.767+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:06.781 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:06.771+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:06.957 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:06.949+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:07.106 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:07.097+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:07.356 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:07.345+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:07.501 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:07.492+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:07.745 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:07.737+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:07.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:07.747+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:07.806 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:07.796+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:07.993 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:07.984+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:08.110 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:08.101+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:08.407 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:08.399+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:08.507 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:08.493+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:08.699 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:08.692+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:08.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:08.767+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:08.844 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:08.836+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:08.988 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:08.979+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:09.086 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:09.077+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:09.416 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:09.408+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:09.554 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:09.545+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:09.684 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:09.675+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:09.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:09.787+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:09.849 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:09.840+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:09.996 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:09.987+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:10.116 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:10.108+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:10.442 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:10.434+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:10.579 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:10.569+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:10.653 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:10.646+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:10.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:10.792+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:10.861 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:10.852+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:10.967 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:10.958+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:11.097 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:11.089+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:11.442 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:11.435+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:11.599 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:11.591+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:11.693 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:11.686+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:11.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:11.780+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:11.845 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:11.836+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:11.989 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:11.980+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:12.086 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:12.078+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:12.456 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:12.448+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:12.591 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:12.581+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:12.649 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:12.641+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:12.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:12.759+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:12.888 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:12.879+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:12.947 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:12.938+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:13.106 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:13.097+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:13.410 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:13.403+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:13.599 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:13.591+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:13.629 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:13.622+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:13.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:13.726+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:13.869 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:13.860+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:13.944 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:13.935+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:14.136 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:14.127+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:14.372 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:14.365+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:14.585 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:14.577+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:14.651 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:14.641+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:14.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:14.726+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:14.845 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:14.837+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:14.936 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:14.927+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:15.131 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:15.123+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:15.419 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:15.411+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:15.550 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:15.543+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:15.689 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:15.680+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:15.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:15.743+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:15.833 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:15.824+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:15.982 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:15.974+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:16.163 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:16.154+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:16.423 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:16.415+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:16.569 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:16.562+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:16.685 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:16.675+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:16.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:16.720+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:16.807 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:16.798+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:16.953 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:16.943+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:17.172 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:17.163+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:17.457 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:17.449+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:17.539 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:17.531+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:17.689 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:17.679+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:17.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:17.683+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:17.783 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:17.774+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:17.986 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:17.976+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:18.137 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:18.126+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:18.458 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:18.451+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:18.526 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:18.519+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:18.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:18.666+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:18.715 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:18.704+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:18.750 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:18.741+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:18.975 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:18.965+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:19.123 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:19.114+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:19.445 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:19.438+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:19.493 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:19.479+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:19.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:19.703+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:19.723 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:19.713+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:19.766 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:19.757+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:20.005 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:19.995+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:20.177 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:20.168+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:20.439 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:20.432+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:20.535 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:20.527+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:20.704 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:20.694+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:20.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:20.715+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:20.778 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:20.768+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:20.966 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:20.955+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:21.229 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:21.220+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:21.458 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:21.451+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:21.579 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:21.572+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:21.701 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:21.691+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:21.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:21.746+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:21.780 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:21.770+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:21.990 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:21.982+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:22.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:22.272+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:22.413 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:22.405+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:22.570 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:22.562+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:22.747 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:22.736+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:22.766 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:22.756+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:22.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:22.764+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:22.966 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:00:22.956+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.264189+0000 front 2019-12-11T18:59:09.261326+0000 (oldest deadline 2019-12-11T18:59:53.956678+0000) 2019-12-11T19:00:23.264 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:00:23.254+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.302031+0000 front 2019-12-11T18:59:06.862840+0000 (oldest deadline 2019-12-11T18:59:52.443519+0000) 2019-12-11T19:00:23.398 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:00:23.390+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:10.471634+0000 front 2019-12-11T18:59:10.473314+0000 (oldest deadline 2019-12-11T18:59:55.113101+0000) 2019-12-11T19:00:23.564 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:00:23.555+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e179 v179) 2019-12-11T19:00:23.622 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:00:23.608+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:09.896997+0000 front 2019-12-11T18:59:09.814566+0000 (oldest deadline 2019-12-11T18:59:52.673884+0000) 2019-12-11T19:00:23.713 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:00:23.705+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:11.132982+0000 front 2019-12-11T18:59:11.509558+0000 (oldest deadline 2019-12-11T18:59:52.322183+0000) 2019-12-11T19:00:23.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:00:23.733+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.314282+0000 front 2019-12-11T18:59:07.322020+0000 (oldest deadline 2019-12-11T18:59:52.958951+0000) 2019-12-11T19:00:23.759 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:00:23.749+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T18:59:07.557413+0000 front 2019-12-11T18:59:07.379430+0000 (oldest deadline 2019-12-11T18:59:52.023423+0000) 2019-12-11T19:00:24.886 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:25.102 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.894 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:25.109 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.911 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:25.127 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.911 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:25.085 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.913 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:25.130 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.917 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:25.091 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.959 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:25.133 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.960 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:25.173 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:24.960 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:25.176 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.724 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:43.940 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.743 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:43.960 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.774 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:18:43.990 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.776 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:43.993 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.780 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:43.954 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.781 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:43.998 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.784 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:43.958 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.810 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:18:44.026 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:00:43.825 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:18:43.999 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:01:00.530 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:00.519+0000 124b0700 -1 osd.0 183 build_incremental_map_msg missing incremental map 183 2019-12-11T19:01:00.629 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:00.622+0000 124b0700 -1 osd.0 183 build_incremental_map_msg missing incremental map 183 2019-12-11T19:01:00.633 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:00.602+0000 114ae700 -1 osd.6 183 build_incremental_map_msg missing incremental map 183 2019-12-11T19:01:00.652 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:00.640+0000 11caf700 -1 osd.6 183 build_incremental_map_msg missing incremental map 183 2019-12-11T19:01:01.670 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:01.657+0000 31f87700 -1 osd.2 184 build_incremental_map_msg missing incremental map 184 2019-12-11T19:01:01.740 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:01.691+0000 35f8f700 -1 osd.2 184 build_incremental_map_msg missing incremental map 184 2019-12-11T19:01:01.813 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:01.797+0000 37f93700 -1 osd.2 184 build_incremental_map_msg missing incremental map 184 2019-12-11T19:01:02.247 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:02.075+0000 31786700 -1 osd.2 184 build_incremental_map_msg missing incremental map 184 2019-12-11T19:01:03.396 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:01:03.333+0000 32f89700 -1 osd.7 184 build_incremental_map_msg missing incremental map 184 2019-12-11T19:01:20.834 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:20.827+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:21.590 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:21.583+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:21.858 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:21.850+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:21.860 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:21.851+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:21.993 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:21.985+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:22.605 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:22.598+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:22.874 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:22.867+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:22.908 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:22.901+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:22.997 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:22.989+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:23.619 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:23.612+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:23.890 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:23.881+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:23.938 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:23.930+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:23.968 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:23.960+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:24.576 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:24.568+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:24.890 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:24.881+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:24.911 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:24.903+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:24.926 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:24.919+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:25.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:25.164+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:25.586 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:25.578+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:25.884 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:25.875+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:25.912 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:25.904+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:25.949 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:25.937+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:26.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:26.205+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:26.230 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:26.222+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:26.639 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:26.630+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:26.872 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:26.865+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:26.907 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:26.896+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:26.954 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:26.946+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:27.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:27.174+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:27.243 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:27.236+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:27.634 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:27.625+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:27.834 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:27.827+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:27.896 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:27.887+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:27.918 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:27.911+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:28.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:28.144+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:28.295 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:28.286+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:28.662 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:28.654+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:28.882 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:28.874+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:28.904 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:28.896+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:28.905 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:28.898+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:29.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:29.114+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:29.292 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:29.285+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:29.685 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:29.677+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:29.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:29.873+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:29.888 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:29.879+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:29.936 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:29.928+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:30.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:30.075+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:30.299 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:30.293+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:30.714 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:30.706+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:30.893 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:30.885+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:30.934 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:30.927+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:30.944 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:30.936+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:31.051 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:31.044+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:31.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:31.077+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:31.277 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:31.269+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:31.719 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:31.711+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:31.939 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:31.933+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:31.941 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:31.933+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:31.954 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:31.946+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:32.052 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:32.046+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:32.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:32.081+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:32.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:32.290+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:32.714 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:32.706+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:32.915 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:32.907+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:32.949 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:32.942+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:32.958 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:32.950+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:33.010 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:33.003+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:33.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:33.087+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:33.296 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:33.289+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:33.671 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:33.664+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:33.925 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:33.917+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:33.948 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:33.939+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:33.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:33.972+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:34.022 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:34.015+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:34.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:34.089+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:34.272 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:34.265+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:34.634 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:34.627+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:34.887 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:34.880+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:34.975 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:34.968+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:34.992 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:34.985+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:35.051 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:35.044+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:35.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:35.115+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:35.268 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:35.261+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:35.597 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:35.589+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:35.870 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:35.861+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:35.956 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:35.949+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:36.006 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:35.998+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:36.055 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:36.045+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:36.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:36.154+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:36.230 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:36.223+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:36.576 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:36.568+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:36.861 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:36.854+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:36.914 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:36.907+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:36.974 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:36.966+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:37.047 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:37.038+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:37.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:37.123+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:37.270 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:37.262+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:37.591 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:37.582+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:37.832 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:37.824+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:37.892 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:37.885+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:37.982 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:37.975+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:38.026 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:38.019+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:38.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:38.116+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:38.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:38.294+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:38.601 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:38.591+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:38.858 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:38.851+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:38.938 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:38.931+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:38.939 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:38.931+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:39.001 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:38.992+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:39.003 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:38.994+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:39.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:39.160+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:39.345 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:39.338+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:39.574 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:39.566+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:39.873 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:39.865+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:39.964 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:39.956+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:39.964 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:39.957+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:40.025 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:40.018+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:40.027 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:40.020+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:40.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:40.114+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:40.307 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:40.299+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:40.620 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:40.611+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:40.905 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:40.897+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:40.919 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:40.912+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:40.960 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:40.952+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:41.079 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:41.069+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:41.080 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:41.072+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:41.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:41.081+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:41.279 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:41.272+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:41.642 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:41.634+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:41.877 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:41.869+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:41.936 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:41.928+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:41.936 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:41.929+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:42.069 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:42.060+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:42.070 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:42.062+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:42.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:42.066+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:42.316 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:42.309+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:42.653 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:42.646+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:42.852 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:42.844+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:42.902 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:42.894+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:42.943 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:42.936+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:43.031 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:43.021+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:43.032 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:43.023+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:43.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:43.049+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:43.368 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:43.360+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:43.614 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:43.606+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:43.857 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:43.848+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:43.866 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:43.858+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:43.969 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:43.962+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:44.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:44.046+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:44.069 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:44.061+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:44.071 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:44.063+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:44.416 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:44.409+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:44.575 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:44.567+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:44.836 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:44.829+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:44.897 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:44.889+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:44.944 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:44.936+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:45.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:45.071+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:45.110 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:45.102+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:45.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:45.105+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:45.428 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:45.421+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:45.595 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:45.587+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:45.824 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:45.816+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:45.908 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:45.899+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:45.925 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:45.917+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:46.071 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:46.062+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:46.073 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:46.064+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:46.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:46.123+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:46.449 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:46.441+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:46.562 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:46.553+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:46.785 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:46.777+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:46.940 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:46.933+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:46.940 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:46.932+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:47.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:47.106+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:47.117 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:47.109+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:47.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:47.140+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:47.412 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:47.405+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:47.547 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:47.539+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:47.793 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:47.785+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:47.898 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:47.888+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:47.937 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:47.930+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:48.144 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:48.137+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:48.148 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:48.141+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:48.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:48.152+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:48.470 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:48.462+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:48.527 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:48.520+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:48.783 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:48.775+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:48.869 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:48.860+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:48.928 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:48.921+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:49.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:49.138+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:49.198 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:49.190+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:49.199 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:49.192+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:49.489 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:49.482+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:49.537 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:49.529+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:49.815 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:49.808+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:49.840 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:49.832+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:49.955 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:49.948+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:50.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:50.113+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:50.151 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:50.144+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:50.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:50.145+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:50.526 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:50.518+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:50.527 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:50.519+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:50.812 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:50.805+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:50.854 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:50.844+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:50.991 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:50.983+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:51.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:51.165+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:51.186 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:51.179+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:51.193 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:51.185+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:51.538 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:51.529+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:51.554 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:51.544+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:51.835 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:51.827+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:51.865 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:51.857+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:52.032 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:52.023+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:52.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:52.136+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:52.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:52.146+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:52.157 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:52.149+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:52.528 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:52.520+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:52.536 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:52.523+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:52.859 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:52.852+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:52.869 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:52.862+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:53.035 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:53.028+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:53.131 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:53.123+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:53.131 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:53.124+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:53.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:53.180+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:53.520 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:53.511+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:53.537 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:53.529+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:53.834 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:53.826+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:53.870 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:01:53.861+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e185 v185) 2019-12-11T19:01:53.894 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:53.885+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:54.056 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:54.046+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:54.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:54.080+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:54.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:54.081+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:54.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:54.210+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:54.491 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:54.483+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:54.512 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:54.505+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:54.842 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:54.834+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:54.925 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:54.916+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:55.053 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:55.043+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:55.117 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:55.109+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:55.118 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:55.111+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:55.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:55.193+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:55.485 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:55.476+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:55.506 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:55.499+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:55.796 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:55.789+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:55.881 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:55.873+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:56.029 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:56.019+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:56.099 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:56.091+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:56.100 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:56.092+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:56.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:56.217+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:56.451 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:56.442+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:56.520 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:56.512+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:56.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:56.841+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:56.879 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:56.871+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:57.035 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:57.026+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:57.147 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:57.140+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:57.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:57.145+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:57.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:57.176+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:57.430 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:57.422+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:57.502 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:57.495+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:57.855 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:57.847+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:57.904 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:57.895+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:58.055 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:58.046+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:58.178 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:58.169+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:58.178 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:58.171+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:58.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:58.186+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:58.400 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:58.391+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:58.526 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:58.519+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:58.866 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:58.859+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:58.881 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:01:58.873+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e185 v185) 2019-12-11T19:01:58.901 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:58.892+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:01:59.109 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:01:59.100+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:01:59.215 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:59.207+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:01:59.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:01:59.208+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:01:59.216 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:01:59.208+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:01:59.418 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:01:59.410+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:01:59.563 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:01:59.555+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:01:59.861 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:01:59.854+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:01:59.919 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:01:59.910+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:00.129 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:00.120+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:00.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:00.177+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:00.188 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:00.181+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:00.189 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:00.183+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:00.410 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:00.401+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:00.535 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:00.527+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:00.825 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:00.818+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:00.876 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:00.867+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:01.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:01.149+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:01.163 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:01.155+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:01.164 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:01.157+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:01.178 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:01.169+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:01.398 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:01.390+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:01.571 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:01.564+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:01.827 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:01.820+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:01.905 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:01.897+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:02.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:02.140+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:02.150 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:02.144+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:02.151 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:02.142+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:02.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:02.148+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:02.393 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:02.384+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:02.588 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:02.581+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:02.863 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:02.855+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:02.864 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:02.855+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:03.143 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:03.135+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:03.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:03.144+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:03.200 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:03.192+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:03.201 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:03.193+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:03.367 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:03.357+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:03.626 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:03.620+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:03.886 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:03.878+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:03.898 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:02:03.889+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e185 v185) 2019-12-11T19:02:03.907 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:03.899+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:04.134 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:04.125+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:04.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:04.132+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:04.233 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:04.225+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:04.234 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:04.226+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:04.378 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:04.369+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:04.661 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:04.654+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:04.880 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:04.871+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:04.928 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:04.921+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:05.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:05.107+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:05.129 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:05.121+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:05.195 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:05.188+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:05.200 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:05.192+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:05.339 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:05.330+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:05.645 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:05.638+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:05.913 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:05.905+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:05.915 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:05.907+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:06.113 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:06.104+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:06.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:06.109+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:06.212 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:06.202+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:06.213 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:06.205+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:06.314 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:06.306+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:06.639 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:06.632+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:06.893 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:06.886+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:06.961 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:06.953+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:07.114 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:07.106+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:07.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:07.149+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:07.246 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:07.237+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:07.248 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:07.238+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:07.297 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:07.289+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:07.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:07.677+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:07.884 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:07.875+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:08.012 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:08.004+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:08.155 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:08.146+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:08.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:08.190+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:08.280 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:08.271+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:08.284 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:08.276+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:08.337 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:08.329+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:08.713 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:08.701+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:08.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:02:08.904+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e185 v185) 2019-12-11T19:02:08.913 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:08.905+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:09.035 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:09.027+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:09.132 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:09.125+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:09.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:09.213+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:09.259 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:09.252+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:09.262 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:09.254+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:09.302 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:09.295+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:09.682 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:09.673+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:09.873 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:09.866+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:10.028 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:10.020+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:10.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:10.167+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:10.180 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:10.173+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:10.215 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:10.207+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:10.218 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:10.208+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:10.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:10.274+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:10.686 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:10.679+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:10.863 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:10.855+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:11.082 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:11.076+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:11.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:11.152+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:11.181 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:11.174+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:11.188 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:11.180+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:11.189 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:11.182+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:11.248 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:11.240+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:11.723 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:11.716+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:11.838 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:11.830+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:12.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:12.112+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:12.121 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:12.109+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:12.149 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:12.143+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:12.153 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:12.146+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:12.204 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:12.195+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:12.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:12.265+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:12.728 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:12.720+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:12.847 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:12.839+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:13.116 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:13.108+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:13.144 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:13.136+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:00:58.745285+0000 (oldest deadline 2019-12-11T19:01:38.745285+0000) 2019-12-11T19:02:13.146 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:13.137+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:13.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:02:13.166+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.325847+0000 front 2019-12-11T19:00:41.409531+0000 (oldest deadline 2019-12-11T19:01:24.757487+0000) 2019-12-11T19:02:13.257 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:13.249+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:13.316 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:02:13.305+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.065498+0000 front 2019-12-11T19:00:37.330645+0000 (oldest deadline 2019-12-11T19:01:21.238131+0000) 2019-12-11T19:02:13.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:02:13.677+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.978351+0000 front 2019-12-11T19:00:40.977401+0000 (oldest deadline 2019-12-11T19:01:25.889878+0000) 2019-12-11T19:02:13.843 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:02:13.836+0000 1694f700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:36.623315+0000 front 2019-12-11T19:00:36.689512+0000 (oldest deadline 2019-12-11T19:01:21.382253+0000) 2019-12-11T19:02:13.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:02:13.982+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e185 v185) 2019-12-11T19:02:14.108 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:02:14.100+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:34.711564+0000 front 2019-12-11T19:00:34.306281+0000 (oldest deadline 2019-12-11T19:01:20.179767+0000) 2019-12-11T19:02:14.229 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:02:14.222+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:00:40.018652+0000 front 2019-12-11T19:00:39.883274+0000 (oldest deadline 2019-12-11T19:01:21.800163+0000) 2019-12-11T19:02:14.375 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:14.358+0000 1694f700 -1 osd.2 186 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-11T19:02:14.381 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:02:14.372+0000 3578e700 -1 osd.2 186 build_incremental_map_msg missing incremental map 184 2019-12-11T19:02:45.485 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:02:45.463+0000 31786700 -1 osd.7 185 build_incremental_map_msg missing incremental map 184 2019-12-11T19:02:51.871 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:02:51.813+0000 34f8d700 -1 osd.7 190 build_incremental_map_msg missing incremental map 190 2019-12-11T19:02:53.504 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:02:53.483+0000 3378a700 -1 osd.7 191 build_incremental_map_msg missing incremental map 190 2019-12-11T19:03:21.153 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:21.142+0000 1694f700 -1 osd.7 191 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4349.0:106315 5.4 5:2b04a3e9:::notify.6:head [watch reconnect cookie 1471045888 gen 14] snapc 0=[] ondisk+write+known_if_redirected e189) 2019-12-11T19:03:50.703 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:50.692+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:51.394 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:51.386+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:51.744 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:51.735+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:52.050 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:52.040+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:52.128 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:52.120+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:52.272 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:52.263+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:52.442 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:52.433+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:52.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:03:52.532+0000 1694f700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.229438+0000 front 2019-12-11T19:03:09.130132+0000 (oldest deadline 2019-12-11T19:03:52.528836+0000) 2019-12-11T19:03:52.750 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:52.740+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:53.023 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:53.013+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:53.176 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:53.168+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:53.294 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:53.285+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:53.474 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:53.466+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:53.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:03:53.549+0000 1694f700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.229438+0000 front 2019-12-11T19:03:09.130132+0000 (oldest deadline 2019-12-11T19:03:52.528836+0000) 2019-12-11T19:03:53.730 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:53.721+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:54.067 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:54.058+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:54.185 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:54.177+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:54.341 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:54.332+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:54.443 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:54.435+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:54.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:03:54.572+0000 1694f700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.229438+0000 front 2019-12-11T19:03:09.130132+0000 (oldest deadline 2019-12-11T19:03:52.528836+0000) 2019-12-11T19:03:54.782 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:54.774+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:55.091 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:55.082+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:55.194 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:55.188+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:55.314 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:55.305+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:55.492 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:55.484+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:55.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:03:55.529+0000 1694f700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.229438+0000 front 2019-12-11T19:03:09.130132+0000 (oldest deadline 2019-12-11T19:03:52.528836+0000) 2019-12-11T19:03:55.604 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:03:55.595+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:03:55.808 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:55.799+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:56.081 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:56.070+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:56.235 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:56.227+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:56.360 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:56.352+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:56.460 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:56.453+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:56.622 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:03:56.614+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:03:56.828 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:56.819+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:57.118 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:57.109+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:57.192 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:57.184+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:57.406 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:57.398+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:57.455 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:57.448+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:57.666 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:03:57.658+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:03:57.817 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:57.808+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:58.152 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:58.142+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:58.199 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:58.192+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:58.378 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:58.369+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:58.480 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:58.473+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:58.625 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:03:58.617+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:03:58.854 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:58.844+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:03:59.155 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:03:59.145+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:03:59.191 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:03:59.183+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:03:59.417 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:03:59.408+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:03:59.524 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:03:59.516+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:03:59.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:03:59.666+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:03:59.868 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:03:59.859+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:00.179 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:00.170+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:00.189 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:00.182+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:00.391 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:00.375+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:00.533 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:00.526+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:00.650 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:00.642+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:00.869 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:00.860+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:01.141 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:01.132+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:01.205 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:01.198+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:01.352 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:01.343+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:01.551 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:01.544+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:01.656 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:01.647+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:01.903 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:01.894+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:02.137 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:02.128+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:02.252 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:02.244+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:02.317 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:02.307+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:02.569 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:02.560+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:02.613 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:02.604+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:02.936 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:02.927+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:03.107 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:03.098+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:03.251 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:03.244+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:03.332 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:03.324+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:03.530 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:03.523+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:03.593 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:03.585+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:03.917 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:03.909+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:04.114 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:04.105+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:04.227 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:04.220+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:04.318 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:04.310+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:04.551 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:04.543+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:04.561 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:04.553+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:04.974 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:04.961+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:05.100 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:05.092+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:05.230 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:05.222+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:05.359 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:05.350+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:05.557 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:05.549+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:05.605 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:05.597+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:05.952 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:05.942+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:06.098 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:06.089+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:06.237 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:06.229+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:06.401 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:06.392+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:06.569 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:06.562+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:06.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:06.601+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:06.936 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:06.927+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:07.093 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:07.084+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:07.217 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:07.209+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:07.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:07.390+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:07.588 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:07.579+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:07.620 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:07.613+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:07.979 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:07.967+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:08.100 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:08.091+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:08.233 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:08.224+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:08.416 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:08.407+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:08.579 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:08.571+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:08.597 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:08.588+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:08.942 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:08.933+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:09.096 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:09.087+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:09.203 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:09.195+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:09.451 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:09.442+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:09.561 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:09.553+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:09.575 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:09.566+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:09.972 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:09.963+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:10.136 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:10.126+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:10.209 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:10.201+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:10.442 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:10.433+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:10.485 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:22:10.701 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.494 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:22:10.710 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.500 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:22:10.717 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.504 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:22:10.721 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.515 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:22:10.689 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.529 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:22:10.703 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.533 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:10.524+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:10.591 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:10.584+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:10.746 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:22:10.962 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.754 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:22:10.970 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.843 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:22:11.017 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:04:10.962 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:10.955+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:11.165 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:11.158+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:11.209 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:11.202+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:11.408 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:11.399+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:11.509 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:11.500+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:11.576 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:11.569+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:11.954 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:11.946+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:12.183 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:12.175+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:12.204 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:12.196+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:12.429 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:12.421+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:12.549 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:12.540+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:12.551 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:12.543+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:12.960 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:12.950+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:13.151 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:13.144+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:13.180 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:13.171+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:13.434 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:13.424+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:13.545 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:13.536+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:13.583 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:13.575+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:13.938 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:13.924+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:14.165 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:14.156+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:14.166 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:14.157+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:14.409 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:14.401+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:14.553 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:14.545+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:14.615 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:14.607+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:14.937 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:14.928+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:15.124 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:15.117+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:15.167 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:15.158+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:15.429 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:15.421+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:15.512 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:15.504+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:15.591 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:15.583+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:15.966 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:15.957+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:16.120 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:16.112+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:16.153 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:16.144+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:16.447 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:16.438+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:16.526 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:16.517+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:16.638 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:16.631+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:16.940 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:16.931+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:17.118 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:17.109+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:17.187 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:17.178+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:17.455 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:17.446+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:17.510 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:17.501+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:17.632 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:17.624+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:17.968 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:17.959+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:18.148 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:18.139+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:18.192 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:18.183+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:18.427 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:18.418+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:18.511 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:18.502+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:18.665 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:18.656+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:18.984 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:18.975+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:19.145 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:19.137+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:19.159 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:19.150+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:19.386 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:19.377+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:19.549 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:19.539+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:19.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:19.636+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:20.009 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:19.999+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:20.142 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:20.133+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:20.177 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:20.167+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:20.347 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:20.337+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:20.511 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:20.501+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:20.651 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:20.640+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:20.977 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:20.966+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:21.153 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:21.141+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:21.162 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:21.154+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:21.307 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:21.298+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:21.485 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:21.476+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:21.614 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:21.606+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:21.941 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:21.932+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:22.193 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:22.183+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:22.202 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:22.195+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:22.347 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:22.337+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:22.451 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:22.441+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:22.639 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:22.630+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:22.899 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:22.889+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:23.174 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:23.166+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:23.231 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:23.221+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:23.355 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:23.345+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:23.456 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:23.447+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:23.614 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:23.607+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:23.908 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:23.898+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:04:24.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:04:24.133+0000 1694f700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.264226+0000 front 2019-12-11T19:03:09.835464+0000 (oldest deadline 2019-12-11T19:03:51.932569+0000) 2019-12-11T19:04:24.203 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:04:24.193+0000 1694f700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.343463+0000 front 2019-12-11T19:03:09.852455+0000 (oldest deadline 2019-12-11T19:03:51.541824+0000) 2019-12-11T19:04:24.330 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:04:24.320+0000 1694f700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:10.285216+0000 front 2019-12-11T19:03:09.386173+0000 (oldest deadline 2019-12-11T19:03:51.626389+0000) 2019-12-11T19:04:24.395 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:04:24.383+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 44sec e191 v191) 2019-12-11T19:04:24.446 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:04:24.436+0000 1694f700 -1 osd.5 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:09.721956+0000 front 2019-12-11T19:03:10.283028+0000 (oldest deadline 2019-12-11T19:03:54.891332+0000) 2019-12-11T19:04:24.615 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:04:24.608+0000 1694f700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:08.213445+0000 front 2019-12-11T19:03:08.231109+0000 (oldest deadline 2019-12-11T19:03:50.501092+0000) 2019-12-11T19:04:24.866 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:04:24.856+0000 1694f700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:03:06.039756+0000 front 2019-12-11T19:03:05.940944+0000 (oldest deadline 2019-12-11T19:03:50.012584+0000) 2019-12-11T19:05:14.600 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.528+0000 31f87700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:14.632 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.550+0000 31f87700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:14.644 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.557+0000 35f8f700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:14.695 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.559+0000 3578e700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:14.703 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.585+0000 3578e700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:14.730 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:14.620+0000 32f89700 -1 osd.2 196 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:16.558 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:16.493+0000 33f8b700 -1 osd.2 197 build_incremental_map_msg missing incremental map 196 2019-12-11T19:05:21.334 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:21.327+0000 11caf700 -1 osd.0 197 build_incremental_map_msg missing incremental map 195 2019-12-11T19:05:22.596 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:22.584+0000 1694f700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:23.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:23.051+0000 1694f700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:23.572 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:23.565+0000 1694f700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:24.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:24.015+0000 1694f700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:24.587 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:24.580+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:24.962 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:24.883+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:25.028 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:25.021+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:25.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:25.056+0000 1694f700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:25.639 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:25.632+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:25.717 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:25.709+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:25.772 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:25.765+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:25.889 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:25.882+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:26.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:26.026+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:26.080 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:26.072+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:26.602 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:26.595+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:26.695 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:26.687+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:26.753 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:26.746+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:26.922 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:26.915+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:27.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:27.000+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:27.127 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:27.119+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:27.595 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:27.587+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:27.652 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:27.644+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:27.738 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:27.731+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:27.881 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:27.874+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:27.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:27.962+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:28.137 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:28.129+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:28.596 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:28.588+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:28.620 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:28.612+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:28.719 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:28.711+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:28.867 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:28.859+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:28.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:28.940+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:29.138 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:29.129+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:29.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:29.619+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:29.669 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:29.661+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:29.733 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:29.725+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:29.829 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:29.821+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:29.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:29.937+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:30.094 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:30.086+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:30.674 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:30.666+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:30.703 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:30.696+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:30.712 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:30.704+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:30.818 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:30.809+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:30.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:30.928+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:31.143 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:31.136+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:31.685 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:31.678+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:31.737 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:31.728+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:31.741 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:31.733+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:31.791 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:31.784+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:31.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:31.925+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:32.195 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:32.187+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:32.705 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:32.697+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:32.723 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:32.714+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:32.730 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:32.723+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:32.821 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:32.814+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:32.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:32.946+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:33.211 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:33.204+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:33.709 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:33.702+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:33.715 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:33.708+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:33.756 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:33.749+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:33.819 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:33.812+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:33.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:33.915+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:34.259 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:34.251+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:34.700 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:34.693+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:34.760 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:34.753+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:34.801 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:34.793+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:34.804 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:34.798+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:34.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:34.896+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:35.295 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:35.284+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:35.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:35.663+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:35.756 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:35.748+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:35.773 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:35.766+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:35.784 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:35.777+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:35.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:35.855+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:36.289 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:36.282+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:36.396 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:36.389+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:36.699 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:36.692+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:36.787 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:36.779+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:36.788 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:36.779+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:36.833 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:36.826+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:36.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:36.903+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:37.315 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:37.308+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:37.390 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:37.383+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:37.671 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:37.663+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:37.790 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:37.782+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:37.814 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:37.806+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:37.843 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:37.835+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:37.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:37.873+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:38.280 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:38.272+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:38.371 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:38.364+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:38.678 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:38.672+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:38.764 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:38.755+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:38.870 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:38.861+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:38.876 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:38.868+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:38.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:38.888+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:39.232 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:39.224+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:39.391 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:39.384+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:39.692 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:39.685+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:39.728 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:39.720+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:39.843 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:39.833+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:39.878 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:39.872+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:39.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:39.900+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:40.260 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:40.252+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:40.374 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:40.366+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:40.683 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:40.676+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:40.754 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:40.747+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:40.805 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:40.797+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:40.858 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:40.851+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:40.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:40.873+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:41.220 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:41.213+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:41.401 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:41.393+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:41.719 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:41.712+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:41.734 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:41.726+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:41.777 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:41.769+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:41.815 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:41.808+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:41.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:41.899+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:42.194 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:42.187+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:42.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:42.396+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:42.701 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:42.694+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:42.786 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:42.779+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:42.801 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:42.794+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:42.823 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:42.817+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:42.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:42.925+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:43.196 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:43.187+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:43.384 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:43.377+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:43.673 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:43.665+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:43.760 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:43.752+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:43.787 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:43.779+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:43.815 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:43.806+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:43.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:43.951+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:44.159 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:44.150+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:44.355 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:44.347+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:44.361 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:44.353+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:44.636 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:44.628+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:44.790 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:44.782+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:44.805 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:44.797+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:44.860 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:44.852+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:44.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:44.978+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:45.207 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:45.200+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:45.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:45.395+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:45.406 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:45.397+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:45.610 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:45.603+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:45.764 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:45.756+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:45.786 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:45.778+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:45.879 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:45.871+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:45.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:45.982+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:46.221 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:46.212+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:46.405 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:46.394+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:46.406 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:46.397+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:46.591 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:46.582+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:46.720 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:46.712+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:46.801 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:46.793+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:46.916 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:46.908+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:47.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:47.034+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:47.264 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:47.256+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:47.476 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:47.453+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:47.497 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:47.455+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:47.628 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:47.617+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:47.724 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:47.715+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:47.802 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:47.794+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:47.925 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:47.917+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:48.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:48.032+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:48.289 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:48.281+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:48.440 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:48.433+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:48.444 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:48.437+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:48.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:48.618+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:48.753 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:48.745+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:48.778 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:48.769+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:48.914 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:48.902+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:49.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:49.042+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:49.250 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:49.242+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:49.431 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:49.423+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:49.432 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:49.425+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:49.663 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:49.656+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:49.752 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:49.745+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:49.830 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:49.823+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:49.896 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:49.889+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:50.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:50.068+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:50.218 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:50.210+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:50.392 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:50.384+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:50.394 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:50.385+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:50.702 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:50.694+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:50.802 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:50.794+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:50.849 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:50.842+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:50.932 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:50.925+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:51.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:51.026+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:51.224 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:51.216+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:51.391 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:51.381+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:51.393 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:51.384+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:51.734 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:51.727+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:51.802 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:51.794+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:51.814 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:51.806+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:51.922 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:51.914+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:51.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:51.986+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:52.194 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:52.187+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:52.412 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:52.403+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:52.413 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:52.406+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:52.769 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:52.761+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:52.769 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:52.760+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:52.810 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:52.802+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:52.955 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:52.948+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:53.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:52.997+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:53.155 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:53.148+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:53.435 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:53.426+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:53.436 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:53.428+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:53.798 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:53.791+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:53.818 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:53.810+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:53.819 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:53.812+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:53.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:53.975+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:54.000 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:53.993+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:54.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:54.177+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:54.397 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:54.390+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:54.402 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:54.394+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:54.751 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:05:54.744+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e197 v197) 2019-12-11T19:05:54.790 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:54.782+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:54.838 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:54.831+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:54.863 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:54.857+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:54.958 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:54.951+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:54.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:54.955+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:55.225 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:55.217+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:55.353 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:55.346+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:55.355 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:55.348+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:55.781 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:55.773+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:55.800 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:55.792+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:55.852 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:55.845+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:55.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:55.936+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:55.992 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:55.984+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:56.228 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:56.221+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:56.307 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:56.301+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:56.309 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:56.303+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:56.801 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:56.792+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:56.808 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:56.799+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:56.819 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:56.813+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:56.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:56.972+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:57.015 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:57.008+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:57.255 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:57.246+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:57.288 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:57.278+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:57.290 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:57.281+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:57.823 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:57.816+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:57.828 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:57.818+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:57.838 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:57.829+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:58.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:58.017+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:58.065 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:58.057+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:58.261 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:58.252+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:58.325 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:58.318+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:58.329 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:58.322+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:58.824 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:58.816+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:58.857 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:58.849+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:58.875 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:58.867+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:59.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:58.993+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:05:59.076 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:05:59.069+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:05:59.235 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:05:59.226+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:05:59.377 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:59.370+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:05:59.379 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:05:59.372+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:05:59.759 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:05:59.750+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e197 v197) 2019-12-11T19:05:59.842 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:05:59.836+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:05:59.861 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:05:59.852+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:05:59.891 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:05:59.883+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:05:59.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:05:59.964+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:00.058 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:00.051+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:00.256 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:00.246+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:00.413 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:00.404+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:00.415 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:00.406+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:00.884 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:00.874+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:00.887 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:00.880+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:00.927 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:00.919+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:00.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:00.921+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:01.108 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:01.101+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:01.237 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:01.228+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:01.397 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:01.388+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:01.398 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:01.390+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:01.846 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:01.836+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:01.927 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:01.920+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:01.956 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:01.948+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:01.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:01.965+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:02.071 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:02.063+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:02.210 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:02.201+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:02.416 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:02.408+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:02.417 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:02.409+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:02.880 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:02.872+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:02.946 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:02.939+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:02.966 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:02.958+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:03.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:03.013+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:03.088 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:03.081+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:03.208 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:03.198+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:03.392 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:03.383+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:03.395 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:03.385+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:03.839 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:03.831+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:03.913 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:03.900+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:03.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:03.988+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:04.008 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:03.999+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:04.073 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:04.066+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:04.198 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:04.188+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:04.377 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:04.368+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:04.379 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:04.370+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:04.779 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:06:04.769+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e197 v197) 2019-12-11T19:06:04.886 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:04.878+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:04.943 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:04.937+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:05.034 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:05.027+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:05.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:05.026+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:05.047 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:05.039+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:05.204 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:05.194+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:05.367 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:05.360+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:05.368 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:05.361+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:05.874 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:05.866+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:05.919 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:05.912+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:05.998 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:05.991+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:06.070 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:06.061+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:06.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:06.071+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:06.187 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:06.179+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:06.324 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:06.314+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:06.326 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:06.317+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:06.891 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:06.883+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:06.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:06.938+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:07.024 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:07.017+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:07.028 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:07.020+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:07.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:07.071+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:07.191 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:07.182+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:07.361 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:07.354+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:07.364 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:07.357+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:07.874 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:07.866+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:07.968 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:07.962+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:08.044 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:08.035+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:08.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:08.044+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:08.062 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:08.055+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:08.172 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:08.162+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:08.325 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:08.316+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:08.326 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:08.318+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:08.855 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:08.846+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:08.950 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:08.943+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:09.020 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:09.013+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:09.026 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:09.018+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:09.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:09.034+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:09.183 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:09.173+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:09.302 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:09.295+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:09.303 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:09.296+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:09.790 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:06:09.784+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e197 v197) 2019-12-11T19:06:09.810 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:09.801+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:09.999 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:09.991+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:10.029 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:10.021+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:10.061 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:10.053+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:10.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:10.074+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:10.215 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:10.207+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:10.323 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:10.316+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:10.328 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:10.320+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:10.824 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:10.816+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:11.008 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:11.000+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:11.046 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:11.038+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:11.110 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:11.102+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:11.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:11.114+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:11.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:11.179+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:11.334 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:11.325+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:11.335 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:11.327+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:11.794 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:11.786+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:12.048 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:12.041+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:12.052 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:12.044+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:12.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:12.105+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:12.141 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:12.135+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:12.208 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:12.200+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:12.324 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:12.311+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:12.326 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:12.314+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:12.812 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:12.804+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:13.079 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:13.071+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:13.104 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:13.095+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:13.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:13.098+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:13.115 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:13.107+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:13.259 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:13.251+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:13.366 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:13.358+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:13.368 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:13.360+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:13.853 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:13.845+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:14.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:14.092+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:14.124 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:06:14.117+0000 1694f700 -1 osd.4 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:41.063181+0000 front 2019-12-11T19:04:40.504363+0000 (oldest deadline 2019-12-11T19:05:25.005670+0000) 2019-12-11T19:06:14.131 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:06:14.123+0000 1694f700 -1 osd.3 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.182153+0000 front 2019-12-11T19:04:41.064370+0000 (oldest deadline 2019-12-11T19:05:22.209877+0000) 2019-12-11T19:06:14.133 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:14.127+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:14.276 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:14.268+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:14.410 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:14.401+0000 1694f700 -1 osd.2 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:04:55.471951+0000 (oldest deadline 2019-12-11T19:05:35.471951+0000) 2019-12-11T19:06:14.412 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:14.404+0000 1694f700 -1 osd.2 198 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e195) 2019-12-11T19:06:14.829 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:06:14.821+0000 1694f700 -1 osd.6 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:39.696556+0000 front 2019-12-11T19:04:39.698036+0000 (oldest deadline 2019-12-11T19:05:24.886049+0000) 2019-12-11T19:06:14.848 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:06:14.839+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e197 v197) 2019-12-11T19:06:15.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:06:15.119+0000 1694f700 -1 osd.1 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:40.501073+0000 front 2019-12-11T19:04:40.501845+0000 (oldest deadline 2019-12-11T19:05:22.653699+0000) 2019-12-11T19:06:15.153 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:06:15.146+0000 1694f700 -1 osd.0 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.453257+0000 front 2019-12-11T19:04:38.406132+0000 (oldest deadline 2019-12-11T19:05:23.934234+0000) 2019-12-11T19:06:15.153 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:06:15.124+0000 31786700 -1 osd.2 199 build_incremental_map_msg missing incremental map 196 2019-12-11T19:06:15.251 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:06:15.244+0000 1694f700 -1 osd.5 198 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:04:38.992461+0000 front 2019-12-11T19:04:38.973092+0000 (oldest deadline 2019-12-11T19:05:24.202516+0000) 2019-12-11T19:06:48.099 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:06:48.087+0000 31786700 -1 osd.7 203 build_incremental_map_msg missing incremental map 203 2019-12-11T19:06:48.164 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:06:48.104+0000 32788700 -1 osd.7 203 build_incremental_map_msg missing incremental map 203 2019-12-11T19:06:48.483 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:06:48.453+0000 31786700 -1 osd.7 203 build_incremental_map_msg missing incremental map 203 2019-12-11T19:06:49.237 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:06:49.197+0000 35f8f700 -1 osd.7 204 build_incremental_map_msg missing incremental map 203 2019-12-11T19:07:45.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:45.209+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:45.465 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:45.457+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:46.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:46.198+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:46.435 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:46.426+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:47.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:47.177+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:47.194 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:47.186+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:47.205 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:47.196+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:47.318 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:47.310+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:47.425 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:47.418+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:48.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:48.164+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:48.173 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:48.163+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:48.227 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:48.218+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:48.339 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:48.328+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:48.460 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:48.453+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:48.880 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:48.871+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:49.134 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:49.124+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:49.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:49.176+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:49.231 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:49.223+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:49.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:49.371+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:49.437 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:49.429+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:49.688 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:49.681+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:49.884 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:49.875+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:50.121 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:50.112+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:50.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:50.137+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:50.277 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:50.268+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:50.340 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:50.331+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:50.487 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:50.475+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:50.692 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:50.685+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:50.917 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:50.908+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:51.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:51.105+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:51.135 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:51.126+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:51.320 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:51.309+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:51.335 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:51.325+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:51.516 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:51.510+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:51.668 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:51.661+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:51.896 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:51.888+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:52.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:52.069+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:52.100 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:52.092+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:52.283 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:52.274+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:52.358 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:52.348+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:52.499 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:52.491+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:52.702 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:52.692+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:52.880 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:52.871+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:53.078 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:53.068+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:53.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:53.105+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:53.256 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:53.247+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:53.360 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:53.351+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:53.490 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:53.482+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:53.674 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:53.666+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:53.894 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:53.885+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:54.108 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:54.099+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:54.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:54.156+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:54.287 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:54.279+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:54.330 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:54.321+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:54.481 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:54.473+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:54.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:54.647+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:54.930 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:54.921+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:55.116 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:55.107+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:55.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:55.205+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:55.333 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:55.324+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:55.343 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:55.335+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:55.473 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:55.465+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:55.691 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:55.682+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:55.943 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:55.934+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:56.160 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:56.151+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:56.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:56.165+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:56.311 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:56.302+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:56.379 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:56.371+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:56.490 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:56.483+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:56.686 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:56.676+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:56.985 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:56.975+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:57.127 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:57.118+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:57.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:57.177+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:57.280 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:57.271+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:57.405 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:57.396+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:57.489 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:57.479+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:57.644 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:57.636+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:58.021 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:58.011+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:58.190 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:58.181+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:58.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:58.229+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:58.255 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:58.246+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:58.386 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:58.377+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:58.470 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:58.461+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:58.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:58.662+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:07:59.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:07:59.003+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:07:59.206 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:07:59.197+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:07:59.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:07:59.259+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:07:59.284 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:07:59.275+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:07:59.351 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:07:59.342+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:07:59.431 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:07:59.425+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:07:59.664 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:07:59.657+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:00.050 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:00.041+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:00.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:00.224+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:00.248 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:00.239+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:00.287 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:00.278+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:00.315 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:00.306+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:00.462 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:00.453+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:00.639 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:00.632+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:01.014 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:01.005+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:01.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:01.195+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:01.244 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:01.235+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:01.325 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:01.316+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:01.361 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:01.352+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:01.512 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:01.504+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:01.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:01.647+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:02.004 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:01.995+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:02.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:02.210+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:02.232 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:02.223+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:02.316 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:02.308+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:02.343 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:02.335+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:02.470 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:02.462+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:02.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:02.646+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:03.021 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:03.011+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:03.269 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:03.261+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:03.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:03.264+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:03.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:03.302+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:03.337 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:03.329+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:03.437 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:03.429+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:03.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:03.672+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:03.994 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:03.985+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:04.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:04.221+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:04.288 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:04.279+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:04.299 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:04.290+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:04.321 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:04.312+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:04.477 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:04.468+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:04.647 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:04.640+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:05.000 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:04.990+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:05.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:05.219+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:05.292 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:26:05.508 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.298 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:26:05.514 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.311 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:05.303+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:05.316 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:26:05.532 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.322 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:26:05.538 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.324 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:26:05.499 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.332 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:05.323+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:05.333 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:26:05.508 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.353 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:05.345+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:05.499 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:05.491+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:05.554 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:26:05.770 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.579 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:26:05.753 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.617 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:26:05.834 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:08:05.688 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:05.680+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:06.044 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:06.035+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:06.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:06.214+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:06.305 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:06.295+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:06.335 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:06.327+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:06.375 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:06.368+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:06.543 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:06.536+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:06.712 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:06.706+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:07.003 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:06.995+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:07.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:07.168+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:07.318 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:07.309+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:07.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:07.322+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:07.356 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:07.347+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:07.590 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:07.582+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:07.767 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:07.758+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:08.036 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:08.027+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:08.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:08.180+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:08.327 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:08.318+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:08.363 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:08.355+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:08.387 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:08.378+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:08.625 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:08.617+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:08.767 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:08.756+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:09.056 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:09.048+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:09.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:09.153+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:09.370 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:09.362+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:09.377 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:09.369+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:09.419 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:09.410+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:09.593 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:09.585+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:09.791 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:09.784+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:10.049 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:10.041+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:10.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:10.141+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:10.354 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:10.345+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:10.356 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:10.347+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:10.420 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:10.411+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:10.588 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:10.580+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:10.829 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:10.820+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:11.014 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:11.006+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:11.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:11.098+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:11.320 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:11.310+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:11.350 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:11.341+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:11.417 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:11.409+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:11.613 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:11.602+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:11.796 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:11.788+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:11.971 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:11.962+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:12.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:12.076+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:12.282 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:12.272+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:12.356 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:12.346+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:12.452 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:12.443+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:12.642 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:12.632+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:12.792 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:12.785+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:13.004 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:12.995+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:13.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:13.100+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:13.297 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:13.288+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:13.363 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:13.353+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:13.490 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:13.481+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:13.678 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:13.671+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:13.822 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:13.815+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:14.035 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:14.026+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:14.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:14.119+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:14.280 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:14.271+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:14.333 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:14.324+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:14.470 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:14.462+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:14.717 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:14.708+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:14.817 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:14.810+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:15.066 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:15.058+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:15.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:15.154+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:15.292 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:15.283+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:15.345 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:15.336+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:15.513 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:15.504+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:15.684 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:15.676+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:15.824 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:15.816+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:16.060 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:16.052+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:16.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:16.205+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:16.333 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:16.325+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:16.352 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:16.344+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:16.526 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:16.517+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:16.705 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:16.697+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:16.869 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:16.862+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:17.083 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:17.074+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:17.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:17.161+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:17.350 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:17.341+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:17.385 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:17.376+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:17.534 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:17.525+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:17.678 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:17.671+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:17.852 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:17.844+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:18.050 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:18.041+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:18.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:18.151+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:18.383 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:18.373+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:18.419 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:18.410+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:18.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:18.509+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:18.641 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:18.632+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:18.824 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:18.817+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:19.034 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:19.025+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:19.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:19.129+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:19.371 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:19.362+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:19.388 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:19.380+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:19.519 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:19.510+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:19.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:19.638+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:19.845 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:19.837+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:20.042 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:20.033+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:20.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:20.158+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:20.192 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:08:20.185+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e204 v204) 2019-12-11T19:08:20.328 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:20.319+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:20.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:20.371+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:20.520 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:20.512+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:20.684 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:20.675+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:20.825 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:20.819+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:21.070 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:21.061+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:21.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:21.194+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:21.342 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:21.333+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:21.355 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:21.346+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:21.482 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:21.473+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:21.690 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:21.682+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:21.798 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:21.790+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:22.070 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:22.060+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:22.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:22.172+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:22.345 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:22.335+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:22.381 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:22.371+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:22.535 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:22.525+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:22.691 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:22.683+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:22.819 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:22.812+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:23.063 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:23.053+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:23.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:23.128+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:23.361 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:23.351+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:23.397 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:23.386+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:23.492 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:23.482+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:23.706 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:23.699+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:23.784 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:23.777+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:24.036 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:24.023+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:24.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:24.167+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:24.381 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:08:24.370+0000 1694f700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.789894+0000 front 2019-12-11T19:07:04.791381+0000 (oldest deadline 2019-12-11T19:07:46.371566+0000) 2019-12-11T19:08:24.403 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:24.393+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:24.456 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:08:24.446+0000 1694f700 -1 osd.4 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.131408+0000 front 2019-12-11T19:07:01.279178+0000 (oldest deadline 2019-12-11T19:07:46.408424+0000) 2019-12-11T19:08:24.756 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:08:24.747+0000 1694f700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.014265+0000 front 2019-12-11T19:07:04.015052+0000 (oldest deadline 2019-12-11T19:07:49.245189+0000) 2019-12-11T19:08:24.758 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:24.751+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:08:25.046 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:08:25.037+0000 1694f700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:04.232987+0000 front 2019-12-11T19:07:04.234900+0000 (oldest deadline 2019-12-11T19:07:48.062877+0000) 2019-12-11T19:08:25.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:08:25.215+0000 1694f700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:00.345380+0000 front 2019-12-11T19:07:00.377464+0000 (oldest deadline 2019-12-11T19:07:45.014193+0000) 2019-12-11T19:08:25.241 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:08:25.234+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e204 v204) 2019-12-11T19:08:25.386 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:08:25.378+0000 1694f700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.260180+0000 front 2019-12-11T19:07:01.123548+0000 (oldest deadline 2019-12-11T19:07:46.978360+0000) 2019-12-11T19:08:25.715 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:08:25.707+0000 1694f700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:07:01.798241+0000 front 2019-12-11T19:07:01.799514+0000 (oldest deadline 2019-12-11T19:07:45.273905+0000) 2019-12-11T19:09:05.459 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:27:05.675 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.491 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:27:05.708 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.507 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:27:05.723 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.509 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:27:05.725 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.518 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:27:05.691 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.519 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:27:05.693 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.571 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:27:05.787 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.583 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:27:05.799 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:05.587 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:27:05.761 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:09:08.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:08.564+0000 114ae700 -1 osd.1 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:08.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:08.592+0000 124b0700 -1 osd.1 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:08.819 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:09:08.811+0000 114ae700 -1 osd.6 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:08.826 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:08.818+0000 11caf700 -1 osd.0 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:08.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:08.829+0000 114ae700 -1 osd.1 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:08.875 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:08.864+0000 114ae700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:09.173 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:09.161+0000 124b0700 -1 osd.4 208 build_incremental_map_msg missing incremental map 208 2019-12-11T19:09:22.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:22.601+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:23.201 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:23.192+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:23.384 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:23.376+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:23.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:23.589+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:23.985 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:23.977+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:24.246 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:24.237+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:24.380 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:24.372+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:24.413 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:24.405+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:24.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:24.575+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:24.967 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:24.959+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:25.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:25.252+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:25.397 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:25.389+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:25.422 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:25.414+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:25.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:25.550+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:25.993 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:25.985+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:26.235 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:26.228+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:26.361 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:26.354+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:26.455 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:26.448+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:26.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:26.548+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:27.032 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:27.023+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:27.247 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:27.237+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:27.399 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:27.393+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:27.430 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:27.421+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:27.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:27.524+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:28.071 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:28.063+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:28.291 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:28.284+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:28.417 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:28.410+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:28.425 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:28.417+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:28.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:28.519+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:29.035 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:29.028+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:29.258 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:29.250+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:29.401 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:29.393+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:29.451 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:29.442+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:29.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:29.495+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:30.054 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:30.046+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:30.306 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:30.298+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:30.394 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:30.387+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:30.451 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:30.443+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:30.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:30.531+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:31.062 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:31.054+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:31.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:31.257+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:31.376 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:31.368+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:31.424 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:31.416+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:31.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:31.561+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:32.075 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:32.068+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:32.242 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:32.235+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:32.399 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:32.391+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:32.458 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:32.451+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:32.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:32.539+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:33.087 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:33.079+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:33.195 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:33.188+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:33.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:33.378+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:33.472 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:33.463+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:33.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:33.540+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:34.108 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:34.100+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:34.176 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:34.169+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:34.415 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:34.406+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:34.467 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:34.459+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:34.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:34.504+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:35.094 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:35.086+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:35.215 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:35.208+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:35.412 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:35.404+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:35.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:35.469+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:35.489 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:35.482+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:36.113 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:36.106+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:36.211 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:36.204+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:36.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:36.446+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:36.456 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:36.449+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:36.469 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:36.462+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:37.076 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:37.068+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:37.189 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:37.180+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:37.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:37.410+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:37.473 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:37.465+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:37.483 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:37.476+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:38.113 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:38.105+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:38.172 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:38.165+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:38.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:38.411+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:38.457 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:38.450+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:38.498 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:38.489+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:39.097 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:39.089+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:39.164 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:39.156+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:39.178 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:39.171+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:39.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:39.442+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:39.481 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:39.473+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:39.528 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:39.520+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:40.102 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:40.095+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:40.136 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:40.129+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:40.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:40.150+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:40.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:40.404+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:40.536 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:40.528+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:40.574 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:40.565+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:41.137 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:41.130+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:41.145 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:41.138+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:41.157 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:41.149+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:41.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:41.374+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:41.518 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:41.511+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:41.588 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:41.581+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:42.124 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:42.117+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:42.175 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:42.166+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:42.206 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:42.197+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:42.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:42.415+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:42.541 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:42.533+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:42.574 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:42.565+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:43.092 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:43.085+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:43.168 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:43.160+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:43.243 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:43.235+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:43.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:43.378+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:43.578 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:43.571+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:43.609 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:43.602+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:44.108 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:44.101+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:44.141 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:44.133+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:44.280 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:44.272+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:44.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:44.374+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:44.558 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:44.551+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:44.652 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:44.644+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:45.126 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:45.119+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:45.198 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:45.189+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:45.291 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:45.284+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:45.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:45.387+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:45.607 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:45.600+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:45.617 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:45.609+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:46.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:46.139+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:46.218 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:46.210+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:46.335 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:46.326+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:46.337 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:46.329+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:46.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:46.381+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:46.611 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:46.604+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:46.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:46.638+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:47.136 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:47.129+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:47.222 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:47.213+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:47.313 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:47.305+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:47.314 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:47.306+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:47.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:47.437+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:47.640 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:47.630+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:47.644 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:47.636+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:48.125 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:48.117+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:48.220 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:48.212+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:48.297 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:48.287+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:48.298 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:48.290+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:48.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:48.417+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:48.612 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:48.605+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:48.658 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:48.651+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:49.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:49.139+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:49.203 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:49.195+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:49.313 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:49.304+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:49.315 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:49.307+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:49.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:49.396+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:49.626 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:49.618+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:49.668 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:49.660+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:50.200 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:50.192+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:50.222 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:50.214+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:50.357 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:50.350+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:50.363 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:50.355+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:50.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:50.378+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:50.631 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:50.624+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:50.641 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:50.634+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:51.230 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:51.222+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:51.254 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:51.246+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:51.389 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:51.382+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:51.393 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:51.386+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:51.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:51.427+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:51.614 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:51.606+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:51.641 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:51.633+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:52.242 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:52.234+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:52.292 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:52.281+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:52.391 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:52.384+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:52.394 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:52.387+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:52.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:52.399+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:52.595 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:52.587+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:52.640 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:52.632+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:53.268 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:53.261+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:53.272 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:53.263+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:53.433 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:53.424+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:53.434 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:53.426+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:53.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:53.439+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:53.580 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:53.571+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:53.673 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:53.666+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:54.256 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:54.248+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:54.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:54.309+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:54.459 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:54.450+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:54.461 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:54.453+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:54.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:54.476+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:54.619 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:54.611+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:54.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:54.637+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:55.281 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:55.274+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:55.293 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:55.286+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:55.419 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:55.410+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:55.421 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:55.412+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:55.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:55.436+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:55.617 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:55.610+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:55.677 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:55.670+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:56.244 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:56.237+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:56.348 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:56.338+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:56.424 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:56.415+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:56.426 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:56.418+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:56.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:56.486+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:56.668 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:56.659+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:56.718 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:56.711+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:57.231 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:57.224+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:57.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:57.319+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:57.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:57.397+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:57.406 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:57.400+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:57.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:57.445+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:57.680 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:57.673+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:57.693 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:57.684+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:58.280 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:58.273+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:58.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:58.321+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:58.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:58.400+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:58.418 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:58.410+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:58.419 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:58.411+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:58.664 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:58.657+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:58.665 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:09:58.654+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:09:58.710 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:58.702+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:09:59.299 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:09:59.291+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:09:59.300 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:09:59.291+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:09:59.388 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:59.381+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:09:59.394 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:09:59.386+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:09:59.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:09:59.427+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:09:59.645 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:09:59.637+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:09:59.670 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:09:59.662+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:09:59.686 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:09:59.678+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:00.281 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:00.274+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:00.336 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:00.327+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:00.377 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:00.367+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:00.378 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:00.370+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:00.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:00.465+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:00.619 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:00.609+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:00.621 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:00.610+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:00.631 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:00.624+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:00.651 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:00.642+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:01.282 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:01.274+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:01.340 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:01.330+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:01.342 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:01.333+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:01.378 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:01.369+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:01.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:01.436+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:01.629 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:01.620+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:01.633 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:01.623+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:01.678 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:01.671+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:02.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:02.251+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:02.373 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:02.362+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:02.374 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:02.364+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:02.428 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:02.419+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:02.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:02.428+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:02.649 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:02.640+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:02.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:02.652+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:02.693 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:02.685+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:03.293 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:03.287+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:03.340 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:03.331+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:03.341 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:03.334+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:03.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:03.415+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:03.473 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:03.465+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:03.678 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:03.669+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:03.686 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:03.677+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:03.703 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:03.696+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:04.315 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:04.308+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:04.317 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:04.308+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:04.319 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:04.311+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:04.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:04.428+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:04.493 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:04.485+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:04.661 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:04.654+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:04.692 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:04.683+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:04.715 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:04.706+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:05.325 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:05.318+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:05.340 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:05.332+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:05.341 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:05.333+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:05.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:05.395+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:05.481 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:05.472+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:05.662 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:05.654+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:05.684 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:05.637+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:05.726 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:05.718+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:05.734 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:05.726+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:06.301 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:06.294+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:06.342 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:06.332+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:06.343 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:06.335+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:06.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:06.379+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:06.457 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:06.447+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:06.699 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:06.691+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:06.770 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:06.761+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:06.787 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:06.779+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:07.349 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:07.340+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:07.361 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:07.353+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:07.364 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:07.356+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:07.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:07.395+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:07.436 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:07.427+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:07.726 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:07.718+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:07.729 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:07.720+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:07.777 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:07.769+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:08.336 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:08.327+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:08.391 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:08.380+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:08.391 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:08.382+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:08.392 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:08.383+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:08.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:08.426+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:08.708 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:08.698+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:08.721 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:08.713+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:08.773 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:08.764+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:09.360 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:09.351+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:09.374 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:09.365+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:09.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:09.384+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:09.435 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:09.425+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:09.436 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:09.428+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:09.681 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:09.673+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:09.751 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:09.741+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:09.816 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:09.803+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:10.317 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:10.310+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:10.332 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:10.323+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:10.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:10.403+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:10.476 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:10.468+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:10.478 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:10.472+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:10.639 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:10.632+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:10.658 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:10.650+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:10.707 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:10.699+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:10.765 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:10.756+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:11.323 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:11.317+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:11.353 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:11.346+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:11.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:11.363+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:11.441 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:11.432+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:11.441 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:11.434+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:11.669 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:11.662+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:11.731 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:11.723+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:11.735 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:11.727+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:12.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:12.318+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:12.375 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:12.368+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:12.397 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:12.390+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:12.398 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:12.389+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:12.399 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:12.391+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:12.689 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:12.682+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:12.761 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:12.753+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:12.768 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:12.760+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:13.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:13.322+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:13.391 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:13.383+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:13.410 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:13.403+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:13.425 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:13.417+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:13.427 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:13.419+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:13.735 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:13.727+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:13.736 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:13.728+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:13.795 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:13.786+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:14.349 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:14.341+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:14.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:14.345+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:14.419 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:14.412+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:14.429 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:14.421+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:14.429 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:14.423+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:14.724 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:14.716+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:14.767 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:14.759+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:14.824 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:14.817+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:15.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:15.317+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:15.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:15.333+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:15.397 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:15.389+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:15.449 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:15.440+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:15.450 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:15.443+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:15.702 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:15.694+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:15.770 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:15.762+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:15.787 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:15.781+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:15.804 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:15.797+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:16.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:16.323+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:16.361 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:16.354+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:16.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:16.357+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:16.423 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:16.414+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:16.425 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:16.417+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:16.745 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:16.736+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:16.829 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:16.822+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:16.840 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:16.832+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:17.344 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:17.328+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:17.345 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:17.337+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:17.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:17.410+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:17.460 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:17.452+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:17.462 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:17.454+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:17.747 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:17.740+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:17.803 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:17.797+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:17.862 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:17.854+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:18.340 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:18.333+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:18.351 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:18.344+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:18.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:18.418+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:18.482 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:18.474+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:18.487 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:18.475+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:18.708 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:18.701+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:18.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:18.792+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:18.821 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:18.813+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:19.297 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:19.290+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:19.311 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:19.304+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:19.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:19.420+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:19.478 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:19.469+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:19.480 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:19.471+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:19.714 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:19.705+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:19.794 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:19.787+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:19.835 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:19.828+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:20.349 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:20.341+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:20.362 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:20.354+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:20.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:20.459+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:20.511 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:20.503+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:20.525 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:20.508+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:20.723 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:20.712+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:20.762 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:20.751+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:20.767 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:20.759+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:20.822 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:20.815+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:21.347 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:21.339+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:21.348 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:21.341+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:21.471 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:21.463+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:21.472 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:21.465+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:21.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:21.490+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:21.766 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:21.758+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:21.794 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:21.786+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:21.824 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:21.817+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:22.315 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:22.307+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:22.391 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:22.384+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:22.479 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:22.471+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:22.480 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:22.473+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:22.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:22.541+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:22.747 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:22.739+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:22.761 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:22.753+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:22.795 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:22.788+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:23.357 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:23.350+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:23.379 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:23.371+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:23.511 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:23.501+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:23.512 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:23.504+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:23.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:23.529+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:23.712 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:23.705+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:23.783 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:23.775+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:23.835 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:23.828+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:24.372 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:24.365+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:24.390 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:24.383+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:24.485 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:24.476+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:24.486 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:24.478+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:24.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:24.503+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:24.699 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:24.692+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:24.772 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:24.764+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:24.824 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:24.817+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:25.357 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:10:25.350+0000 1694f700 -1 osd.3 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.684556+0000 front 2019-12-11T19:08:38.287171+0000 (oldest deadline 2019-12-11T19:09:22.559880+0000) 2019-12-11T19:10:25.437 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:10:25.430+0000 1694f700 -1 osd.4 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:42.193758+0000 front 2019-12-11T19:08:42.213186+0000 (oldest deadline 2019-12-11T19:09:23.965695+0000) 2019-12-11T19:10:25.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:10:25.503+0000 1694f700 -1 osd.1 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.585735+0000 front 2019-12-11T19:08:40.588981+0000 (oldest deadline 2019-12-11T19:09:21.936638+0000) 2019-12-11T19:10:25.537 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:25.527+0000 1694f700 -1 osd.2 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:09:05.655858+0000 (oldest deadline 2019-12-11T19:09:45.655858+0000) 2019-12-11T19:10:25.539 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:10:25.530+0000 1694f700 -1 osd.2 210 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4349.0:105738 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e208) 2019-12-11T19:10:25.664 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:10:25.656+0000 1694f700 -1 osd.5 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.401286+0000 front 2019-12-11T19:08:41.399543+0000 (oldest deadline 2019-12-11T19:09:22.770710+0000) 2019-12-11T19:10:25.779 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:10:25.766+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 48sec e210 v210) 2019-12-11T19:10:25.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:10:25.794+0000 1694f700 -1 osd.0 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:41.056212+0000 front 2019-12-11T19:08:40.793225+0000 (oldest deadline 2019-12-11T19:09:23.508254+0000) 2019-12-11T19:10:25.821 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:10:25.812+0000 1694f700 -1 osd.6 210 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:08:40.937214+0000 front 2019-12-11T19:08:40.020550+0000 (oldest deadline 2019-12-11T19:09:57.645578+0000) 2019-12-11T19:10:46.202 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:46.192+0000 124b0700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:10:46.626 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:46.580+0000 35f8f700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:10:47.059 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:46.817+0000 32f89700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:10:47.451 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:47.381+0000 31786700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:10:47.645 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:47.599+0000 37792700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:10:48.740 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:10:48.714+0000 35f8f700 -1 osd.7 215 build_incremental_map_msg missing incremental map 215 2019-12-11T19:11:44.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:44.252+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:44.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:44.317+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:45.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:45.237+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:45.288 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:45.275+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:45.379 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:45.370+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:46.055 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:46.045+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:46.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:46.248+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:46.291 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:46.281+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:46.424 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:46.414+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:47.079 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:47.069+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:47.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:47.249+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:47.333 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:47.323+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:47.478 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:47.467+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:48.121 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:48.111+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:48.134 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:48.125+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:48.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:48.231+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:48.377 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:48.366+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:48.449 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:48.440+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:49.159 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:49.150+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:49.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:49.156+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:49.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:49.276+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:49.422 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:49.413+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:49.465 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:49.456+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:50.117 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:50.108+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:50.158 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:50.149+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:50.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:50.265+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:50.421 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:50.413+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:50.451 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:50.443+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:50.645 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:50.637+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:51.134 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:51.124+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:51.142 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:51.133+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:51.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:51.280+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:51.457 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:51.448+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:51.492 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:51.483+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:51.677 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:51.669+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:52.098 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:52.090+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:52.105 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:52.096+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:52.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:52.306+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:52.494 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:52.486+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:52.534 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:52.526+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:52.704 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:52.696+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:53.097 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:53.088+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:53.125 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:53.115+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:53.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:53.299+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:53.469 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:53.460+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:53.554 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:53.545+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:53.739 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:53.731+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:54.071 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:54.063+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:54.098 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:54.089+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:54.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:54.317+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:54.459 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:54.449+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:54.602 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:54.593+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:54.717 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:54.709+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:55.057 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:55.048+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:55.118 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:55.109+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:55.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:55.342+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:55.465 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:55.457+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:55.648 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:55.639+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:55.707 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:55.700+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:56.010 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:56.002+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:56.083 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:56.074+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:56.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:56.360+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:56.499 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:56.489+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:56.631 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:56.623+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:56.721 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:56.714+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:57.015 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:57.006+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:57.046 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:57.037+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:57.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:57.377+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:57.512 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:57.503+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:57.654 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:57.645+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:57.687 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:57.681+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:57.979 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:57.970+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:58.051 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:58.042+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:58.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:58.358+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:58.540 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:58.532+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:58.644 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:58.636+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:58.676 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:58.667+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:58.943 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:58.934+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:11:59.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:11:59.022+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:11:59.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:11:59.325+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:11:59.548 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:11:59.539+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:11:59.602 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:11:59.594+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:11:59.731 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:11:59.719+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:11:59.912 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:11:59.904+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:00.039 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:00.029+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:00.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:00.310+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:00.582 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:00.573+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:00.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:00.638+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:00.718 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:00.709+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:00.927 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:00.918+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:01.080 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:01.071+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:01.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:01.347+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:01.623 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:01.611+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:01.632 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:01.624+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:01.748 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:01.740+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:01.951 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:01.941+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:02.043 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:02.034+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:02.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:02.339+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:02.601 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:02.593+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:02.645 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:02.637+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:02.750 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:02.741+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:02.977 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:02.967+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:03.019 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:03.011+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:03.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:03.352+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:03.579 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:03.569+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:03.634 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:03.627+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:03.759 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:03.750+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:03.985 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:03.976+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:04.005 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:03.997+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:04.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:04.329+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:04.542 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:04.533+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:04.620 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:04.612+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:04.740 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:04.732+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:04.972 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:04.962+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:05.018 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:05.008+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:05.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:05.377+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:05.545 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:05.535+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:05.596 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:05.588+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:05.763 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:05.754+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:05.974 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:05.965+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:06.019 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:06.010+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:06.206 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:06.423 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.217 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:06.433 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.229 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:06.445 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.232 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:06.449 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.236 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:06.410 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.241 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:06.415 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:06.335+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:06.432 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:06.649 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.438 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:06.613 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.442 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:06.659 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:06.524 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:06.516+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:06.569 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:06.561+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:06.778 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:06.770+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:06.974 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:06.967+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:06.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:06.978+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:07.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:07.378+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:07.522 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:07.514+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:07.570 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:07.562+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:07.803 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:07.795+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:07.945 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:07.937+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:07.957 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:07.949+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:08.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:08.351+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:08.520 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:08.512+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:08.587 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:08.579+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:08.760 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:08.752+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:08.954 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:08.946+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:09.006 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:08.996+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:09.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:09.375+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:09.512 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:09.503+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:09.548 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:09.540+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:09.636 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:09.629+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:09.735 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:09.726+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:09.959 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:09.951+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:10.054 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:10.045+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:10.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:10.402+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:10.497 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:10.488+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:10.531 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:10.523+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:10.627 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:10.618+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:10.777 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:10.767+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:10.929 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:10.920+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:11.093 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:11.084+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:11.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:11.377+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:11.500 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:11.493+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:11.525 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:11.517+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:11.637 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:11.630+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:11.741 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:11.733+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:11.983 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:11.974+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:12.143 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:12.135+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:12.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:12.427+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:12.477 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:12.469+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:12.556 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:12.540+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:12.621 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:12.613+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:12.779 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:12.770+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:13.006 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:12.994+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:13.167 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:13.158+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:13.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:13.415+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:13.517 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:13.510+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:13.599 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:13.591+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:13.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:13.648+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:13.796 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:13.788+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:14.023 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:14.014+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:14.166 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:14.157+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:14.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:14.451+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:14.477 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:14.468+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:14.567 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:14.558+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:14.638 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:14.629+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:14.853 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:14.844+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:15.018 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:15.009+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:15.132 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:15.121+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:15.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:15.410+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:15.477 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:15.468+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:15.578 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:15.569+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:15.682 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:15.674+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:15.886 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:15.877+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:16.053 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:16.045+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:16.129 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:12:16.120+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e215 v215) 2019-12-11T19:12:16.166 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:16.157+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:16.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:16.440+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:16.467 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:16.460+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:16.597 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:16.588+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:16.659 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:16.650+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:16.897 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:16.888+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:17.014 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:17.005+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:17.159 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:17.151+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:17.455 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:17.447+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:17.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:17.490+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:17.619 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:17.611+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:17.652 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:17.643+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:17.877 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:17.868+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:17.988 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:17.980+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:18.170 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:18.161+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:18.433 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:18.425+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:18.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:18.518+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:18.619 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:18.611+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:18.662 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:18.654+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:18.917 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:18.907+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:18.985 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:18.973+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:19.128 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:19.119+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:19.424 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:19.416+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:19.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:19.499+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:19.576 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:19.567+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:19.657 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:19.647+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:19.947 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:19.938+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:19.968 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:19.959+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:20.154 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:20.145+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:20.393 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:20.385+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:20.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:20.471+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:20.603 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:20.595+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:20.683 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:20.673+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:20.949 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:20.940+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:20.974 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:20.964+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:21.124 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:21.114+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:21.146 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:12:21.140+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e215 v215) 2019-12-11T19:12:21.389 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:21.382+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:21.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:21.486+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:21.574 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:21.567+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:21.705 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:21.697+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:21.972 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:21.963+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:21.995 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:21.986+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:22.134 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:22.124+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:22.353 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:22.347+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:22.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:22.449+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:22.612 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:22.604+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:22.696 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:22.684+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:22.955 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:22.947+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:23.025 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:23.017+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:23.089 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:23.080+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:23.401 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:23.394+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:23.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:23.461+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:23.569 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:23.562+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:23.732 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:23.722+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:23.926 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:23.917+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:24.058 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:24.050+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:24.088 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:24.079+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:24.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:24.419+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:24.445 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:24.437+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:24.583 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:24.574+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:24.767 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:24.757+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:24.948 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:24.938+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:25.055 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:25.045+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:25.102 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:25.092+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:25.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:25.374+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:25.397 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:12:25.390+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:02.272385+0000 front 2019-12-11T19:11:02.378221+0000 (oldest deadline 2019-12-11T19:12:09.204175+0000) 2019-12-11T19:12:25.565 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:25.557+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:25.779 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:12:25.769+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.860996+0000 front 2019-12-11T19:10:59.921308+0000 (oldest deadline 2019-12-11T19:11:43.878255+0000) 2019-12-11T19:12:25.929 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:12:25.919+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.943235+0000 front 2019-12-11T19:11:00.863609+0000 (oldest deadline 2019-12-11T19:11:45.301049+0000) 2019-12-11T19:12:26.056 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:12:26.046+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.307078+0000 front 2019-12-11T19:11:03.286274+0000 (oldest deadline 2019-12-11T19:11:47.936855+0000) 2019-12-11T19:12:26.089 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:12:26.080+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:00.081777+0000 front 2019-12-11T19:11:00.072887+0000 (oldest deadline 2019-12-11T19:11:44.697920+0000) 2019-12-11T19:12:26.203 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:12:26.194+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e215 v215) 2019-12-11T19:12:26.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:12:26.399+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:10:59.178042+0000 front 2019-12-11T19:10:59.176086+0000 (oldest deadline 2019-12-11T19:11:44.048498+0000) 2019-12-11T19:12:26.540 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:12:26.533+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:11:03.867202+0000 front 2019-12-11T19:11:03.955892+0000 (oldest deadline 2019-12-11T19:11:49.726186+0000) 2019-12-11T19:12:56.557 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:56.774 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.584 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:56.800 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.596 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:56.812 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.617 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:56.791 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.618 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:56.834 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.624 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:56.798 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.677 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:30:56.893 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.694 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:30:56.868 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:12:56.704 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:30:56.920 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:13:22.777 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:22.770+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:23.497 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:23.487+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:23.810 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:23.803+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:24.182 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:24.174+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:24.506 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:24.497+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:24.772 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:24.764+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:25.137 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:25.130+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:25.546 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:25.538+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:25.659 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:25.653+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:25.731 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:25.725+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:26.162 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:26.153+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:26.533 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:26.525+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:26.692 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:26.685+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:26.701 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:26.693+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:27.139 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:27.130+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:27.172 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:27.163+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:27.526 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:27.519+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:27.693 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:27.685+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:27.724 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:27.717+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:28.183 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:28.176+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:28.184 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:28.176+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:28.548 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:28.540+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:28.657 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:28.650+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:28.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:28.674+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:29.155 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:29.147+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:29.198 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:29.189+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:29.558 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:29.549+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:29.697 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:29.690+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:29.699 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:29.692+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:30.134 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:30.126+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:30.225 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:30.217+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:30.590 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:30.583+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:30.698 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:30.690+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:30.714 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:30.707+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:31.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:31.159+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:31.205 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:31.197+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:31.548 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:31.541+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:31.690 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:31.681+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:31.690 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:31.683+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:32.161 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:32.153+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:32.182 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:32.174+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:32.536 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:32.528+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:32.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:32.582+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:32.684 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:32.677+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:32.727 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:32.718+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:32.819 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:32.813+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:33.149 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:33.140+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:33.189 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:33.181+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:33.499 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:33.492+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:33.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:33.610+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:33.685 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:33.678+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:33.692 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:33.684+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:33.848 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:33.841+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:34.113 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:34.104+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:34.195 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:34.187+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:34.551 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:34.543+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:34.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:34.633+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:34.649 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:34.642+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:34.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:34.647+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:34.847 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:34.839+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:35.163 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:35.156+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:35.214 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:35.206+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:35.578 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:35.567+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:35.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:35.589+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:35.664 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:35.657+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:35.694 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:35.688+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:35.820 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:35.813+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 19 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:36.143 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:36.134+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:36.262 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:36.254+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:36.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:36.611+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:36.626 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:36.617+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:36.653 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:36.645+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:36.681 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:36.674+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:36.838 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:36.831+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:37.112 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:37.105+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:37.248 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:37.238+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:37.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:37.576+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:37.605 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:37.597+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:37.637 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:37.630+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:37.657 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:37.650+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:37.837 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:37.830+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:38.148 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:38.141+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:38.301 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:38.284+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:38.601 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:38.589+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:38.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:38.612+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:38.622 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:38.615+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:38.655 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:38.645+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:38.877 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:38.870+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:38.879 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:38.872+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:39.172 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:39.164+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:39.314 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:39.306+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:39.568 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:39.559+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:39.597 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:39.586+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:39.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:39.665+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:39.678 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:39.670+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:39.867 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:39.859+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:39.867 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:39.861+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:40.209 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:40.199+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:40.348 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:40.340+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:40.571 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:40.564+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:40.585 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:40.578+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:40.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:40.637+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:40.699 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:40.690+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:40.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:40.911+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:40.923 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:40.915+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:41.211 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:41.202+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:41.382 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:41.375+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:41.528 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:41.520+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:41.561 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:41.552+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:41.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:41.602+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:41.677 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:41.667+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:41.880 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:41.874+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:41.883 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:41.877+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:42.255 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:42.247+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:42.397 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:42.389+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:42.536 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:42.528+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:42.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:42.558+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:42.581 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:42.573+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:42.732 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:42.723+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:42.892 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:42.883+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:42.894 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:42.885+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:43.285 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:43.277+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:43.392 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:43.384+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:43.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:43.530+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:43.551 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:43.544+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:43.606 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:43.598+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:43.753 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:43.745+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:43.850 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:43.842+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:43.851 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:43.844+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:44.274 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:44.265+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:44.374 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:44.366+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:44.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:44.560+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:44.594 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:44.586+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:44.605 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:44.595+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:44.711 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:44.703+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:44.830 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:44.822+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:44.833 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:44.825+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:45.243 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:45.232+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:45.352 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:45.344+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:45.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:45.605+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:45.631 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:45.623+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:45.633 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:45.625+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:45.689 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:45.681+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:45.814 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:45.804+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:45.816 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:45.806+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:46.270 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:46.262+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:46.338 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:46.331+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:46.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:46.576+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:46.665 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:46.657+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:46.673 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:46.665+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:46.693 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:46.678+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:46.769 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:46.761+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:46.773 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:46.765+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:47.283 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:47.275+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:47.317 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:47.309+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:47.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:47.536+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:47.642 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:47.633+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:47.661 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:47.653+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:47.712 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:47.704+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:47.815 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:47.807+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:47.817 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:47.810+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:48.268 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:48.260+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:48.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:48.327+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:48.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:48.588+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:48.640 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:48.633+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:48.661 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:48.653+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:48.754 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:48.742+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:48.843 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:48.836+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:48.846 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:48.840+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:49.256 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:49.248+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:49.337 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:49.329+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:49.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:49.553+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:49.652 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:49.645+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:49.692 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:49.684+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:49.803 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:49.796+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:49.873 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:49.866+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:49.878 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:49.870+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:50.302 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:50.294+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:50.323 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:50.315+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:50.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:50.602+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:50.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:50.627+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:50.680 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:50.673+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:50.846 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:50.838+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:50.895 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:50.888+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:50.899 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:50.892+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:51.281 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:51.273+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:51.360 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:51.352+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:51.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:51.581+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:51.605 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:51.598+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:51.719 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:51.710+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:51.894 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:51.888+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:51.933 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:51.920+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:51.933 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:51.922+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:52.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:52.306+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:52.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:52.405+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:52.597 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:52.590+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:52.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:52.617+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:52.704 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:52.696+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:52.887 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:52.880+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:52.888 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:52.881+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:52.900 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:52.893+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:53.352 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:53.344+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:53.385 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:53.376+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:53.579 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:53.572+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:53.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:53.604+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:53.703 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:53.693+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:54.059 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:53.864+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:54.059 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:53.889+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:54.060 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:53.890+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:54.341 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:54.333+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:54.388 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:54.380+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:54.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:54.625+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:54.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:54.631+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:54.688 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:54.678+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:54.855 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:54.847+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:54.911 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:54.900+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:54.913 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:54.903+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:55.364 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:55.356+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:55.367 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:55.359+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:55.608 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:55.600+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:55.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:55.612+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:55.686 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:55.679+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:55.830 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:55.822+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:55.941 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:55.932+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:55.941 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:55.934+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:56.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:56.319+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:56.412 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:56.404+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:56.627 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:56.619+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:56.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:56.640+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:56.704 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:13:56.697+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e221 v221) 2019-12-11T19:13:56.731 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:56.723+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:56.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:56.842+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:56.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:56.911+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:56.922 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:56.913+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:57.362 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:57.353+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:57.408 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:57.399+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:57.605 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:57.598+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:57.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:57.657+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:57.754 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:57.745+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:57.842 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:57.836+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:57.887 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:57.880+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:57.893 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:57.885+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:58.375 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:58.367+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:58.389 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:58.381+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:58.643 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:58.631+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:58.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:58.667+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:58.811 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:58.800+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:58.867 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:58.855+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:58.877 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:58.868+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:58.878 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:58.870+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:13:59.383 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:13:59.374+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:13:59.443 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:13:59.435+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:13:59.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:13:59.626+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:13:59.641 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:13:59.634+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:13:59.786 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:13:59.777+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:13:59.857 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:13:59.850+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:13:59.861 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:59.852+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:13:59.862 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:13:59.854+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:00.395 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:00.387+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:00.458 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:00.449+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:00.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:00.592+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:00.642 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:00.634+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:00.814 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:00.804+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:00.864 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:00.855+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:00.866 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:00.858+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:00.867 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:00.859+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:01.393 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:01.383+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:01.457 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:01.445+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:01.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:01.589+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:01.619 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:01.611+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:01.723 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:14:01.714+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e221 v221) 2019-12-11T19:14:01.844 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:01.836+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:01.854 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:01.846+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:01.856 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:01.847+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:01.883 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:01.876+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:02.381 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:02.372+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:02.494 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:02.485+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:02.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:02.544+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:02.592 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:02.585+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:02.846 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:02.838+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:02.848 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:02.840+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:02.856 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:02.847+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:02.857 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:02.845+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:03.373 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:03.363+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:03.496 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:03.483+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:03.574 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:03.566+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:03.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:03.587+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:03.821 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:03.814+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:03.824 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:03.817+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:03.836 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:03.828+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:03.885 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:03.875+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:04.403 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:04.394+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:04.456 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:04.447+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:04.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:04.605+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:04.618 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:04.612+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:04.839 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:04.832+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:04.864 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:04.856+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:04.868 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:04.860+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:04.905 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:04.896+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:05.401 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:05.392+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:05.457 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:05.449+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:05.589 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:05.577+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:05.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:05.595+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:05.880 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:05.868+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:05.882 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:05.874+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:05.883 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:05.876+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:05.883 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:05.875+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:06.417 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:06.408+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:06.488 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:06.480+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:06.576 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:06.568+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:06.599+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:06.737 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:14:06.729+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e221 v221) 2019-12-11T19:14:06.874 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:06.866+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:06.888 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:06.881+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:06.924 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:06.916+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:06.925 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:06.918+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:07.374 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:07.366+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:07.449 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:07.438+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:07.620 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:07.613+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:07.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:07.619+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:07.852 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:07.842+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:07.877 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:07.870+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:07.976 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:07.967+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:07.977 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:07.969+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:08.367 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:08.358+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:08.435 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:08.425+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:08.575 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:08.567+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:08.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:08.606+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:08.904 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:08.894+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:08.912 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:08.905+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:08.996 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:08.990+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:08.998 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:08.992+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:09.417 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:09.409+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:09.423 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:09.411+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:09.566 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:09.558+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:09.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:09.647+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:09.881 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:09.871+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:09.881 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:09.868+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:10.028 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:10.021+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:10.029 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:10.023+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:10.441 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:10.432+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:10.455 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:10.446+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:10.548 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:10.541+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:10.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:10.689+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:10.861 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:10.852+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:10.930 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:10.924+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:11.038 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:11.029+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:12:57.858530+0000 (oldest deadline 2019-12-11T19:13:37.858530+0000) 2019-12-11T19:14:11.039 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:11.031+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-11T19:14:11.430 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:14:11.420+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.485121+0000 front 2019-12-11T19:12:46.299161+0000 (oldest deadline 2019-12-11T19:13:26.154357+0000) 2019-12-11T19:14:11.438 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:14:11.425+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.438061+0000 front 2019-12-11T19:12:39.501097+0000 (oldest deadline 2019-12-11T19:13:24.167139+0000) 2019-12-11T19:14:11.514 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:14:11.507+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:41.815787+0000 front 2019-12-11T19:12:41.924820+0000 (oldest deadline 2019-12-11T19:13:25.335219+0000) 2019-12-11T19:14:11.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:14:11.675+0000 1694f700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:46.299156+0000 front 2019-12-11T19:12:46.259340+0000 (oldest deadline 2019-12-11T19:13:32.406476+0000) 2019-12-11T19:14:11.780 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:14:11.772+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e221 v221) 2019-12-11T19:14:11.871 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:14:11.862+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:43.354617+0000 front 2019-12-11T19:12:42.182929+0000 (oldest deadline 2019-12-11T19:13:23.058609+0000) 2019-12-11T19:14:11.893 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:14:11.880+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:12:39.450151+0000 front 2019-12-11T19:12:41.915017+0000 (oldest deadline 2019-12-11T19:13:21.867121+0000) 2019-12-11T19:14:12.289 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:14:12.142+0000 1694f700 -1 osd.2 222 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4349.0:105863 7.8 7.d5cf4818 (undecoded) ondisk+retry+write+known_if_redirected e219) 2019-12-11T19:14:43.135 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:14:43.127+0000 3578e700 -1 osd.7 221 build_incremental_map_msg missing incremental map 219 2019-12-11T19:15:49.672 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:49.659+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:50.110 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:50.099+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:50.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:50.307+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:50.629 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:50.619+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:51.065 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:51.056+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:51.085 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:51.076+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:51.156 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:51.148+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:51.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:51.301+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:51.645 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:51.636+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:52.049 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:52.038+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:52.108 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:52.100+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:52.121 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:52.113+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:52.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:52.319+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:52.609 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:52.595+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:52.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:52.663+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:53.014 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:53.005+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:53.103 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:53.095+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:53.104 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:53.097+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:53.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:53.285+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:53.565 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:53.555+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:53.624 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:53.617+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:54.017 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:54.008+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:54.116 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:54.108+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:54.161 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:54.147+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:54.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:54.280+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:54.530 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:54.521+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:54.652 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:54.645+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:55.056 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:55.046+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:55.107 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:55.100+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:55.138 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:55.130+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:55.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:55.257+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:55.529 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:55.519+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:55.647 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:55.639+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:56.050 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:56.041+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:56.063 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:56.055+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:56.114 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:56.106+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:56.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:56.272+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:56.563 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:56.553+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:56.627 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:56.616+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:57.070 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:57.061+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:57.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:57.093+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:57.140 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:57.131+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:57.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:57.243+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:57.525 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:57.515+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:57.584 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:57.577+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:58.095 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:58.085+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:58.113 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:58.102+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:58.158 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:58.149+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:58.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:58.275+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:58.515 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:58.505+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:58.582 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:58.573+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:15:59.120 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:15:59.113+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:15:59.149 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:15:59.140+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:15:59.152 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:15:59.143+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:15:59.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:15:59.303+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:15:59.560 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:15:59.551+0000 1694f700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.025882+0000 front 2019-12-11T19:15:05.953813+0000 (oldest deadline 2019-12-11T19:15:48.826490+0000) 2019-12-11T19:15:59.610 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:15:59.603+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:00.128 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:00.119+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:00.129 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:00.121+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:00.186 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:00.177+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:00.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:00.277+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:00.649 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:00.641+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:01.131 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:01.124+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:01.147 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:01.137+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:01.213 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:01.205+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:01.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:01.306+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:01.608 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:01.601+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:02.166 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:02.157+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:02.194 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:02.186+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:02.211 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:02.201+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:02.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:02.265+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:02.371 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:02.362+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:02.563 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:02.556+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:03.157 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:03.149+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:03.176 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:03.167+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:03.256 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:03.247+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:03.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:03.316+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:03.359 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:03.350+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:03.518 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:03.511+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:04.200 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:04.193+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:04.230 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:04.218+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:04.264 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:04.255+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:04.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:04.350+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:04.406 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:04.396+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:04.508 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:04.500+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:05.218 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:05.209+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:05.225 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:05.217+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:05.321 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:05.311+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:05.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:05.393+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:05.453 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:05.445+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:05.488 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:05.479+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:06.185 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:06.178+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:06.205 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:06.199+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:06.254 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:34:06.470 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.262 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:34:06.478 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.272 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:34:06.489 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.278 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:34:06.452 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.279 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:34:06.493 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.288 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:34:06.462 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.324 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:06.316+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:06.432 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:06.423+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:06.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:06.445+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:06.469 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:06.462+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:06.492 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:34:06.708 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.549 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:34:06.723 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:06.574 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:34:06.791 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:16:07.163 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:07.155+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:07.190 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:07.180+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:07.280 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:07.272+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:07.443 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:07.435+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:07.480 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:07.470+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:07.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:07.496+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:08.147 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:08.140+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:08.163 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:08.153+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:08.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:08.318+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:08.486 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:08.478+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:08.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:08.484+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:08.507 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:08.495+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:09.169 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:09.162+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:09.177 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:09.168+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:09.355 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:09.345+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:09.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:09.483+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:09.504 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:09.496+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:09.514 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:09.504+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:10.183 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:10.173+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:10.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:10.192+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:10.401 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:10.392+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:10.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:10.518+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:10.548 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:10.541+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:10.554 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:10.544+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:11.164 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:11.155+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:11.216 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:11.203+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:11.435 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:11.423+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:11.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:11.500+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:11.519 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:11.510+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:11.593 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:11.585+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:12.174 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:12.166+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:12.175 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:12.167+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:12.443 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:12.433+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:12.495 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:12.487+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:12.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:12.522+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:12.563 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:12.556+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:13.139 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:13.130+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:13.171 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:13.162+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:13.431 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:13.422+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:13.546 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:13.536+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:13.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:13.565+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:13.575 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:13.568+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:14.140 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:14.132+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:14.207 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:14.197+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:14.440 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:14.430+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:14.545 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:14.536+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:14.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:14.581+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:14.609 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:14.602+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:15.106 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:15.099+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:15.241 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:15.231+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:15.450 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:15.441+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:15.568 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:15.559+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:15.589 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:15.582+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:15.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:15.585+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:16.157 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:16.148+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:16.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:16.238+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:16.464 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:16.455+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:16.538 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:16.529+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:16.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:16.544+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:16.554 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:16.547+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:17.194 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:17.186+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:17.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:17.273+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:17.477 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:17.468+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:17.557 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:17.547+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:17.561 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:17.553+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:17.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:17.567+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:18.213 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:18.206+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:18.283 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:18.274+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:18.498 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:18.489+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:18.544 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:18.531+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:18.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:18.565+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:18.605 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:18.596+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:19.179 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:19.171+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:19.250 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:19.241+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:19.486 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:19.477+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:19.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:19.522+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:19.590 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:19.581+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:19.643 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:19.635+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:20.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:20.194+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:20.253 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:20.244+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:20.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:20.532+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:20.542 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:20.532+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:20.598 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:20.590+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:20.602 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:20.592+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:21.234 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:21.227+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:21.250 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:21.241+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:21.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:21.523+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:21.591 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:21.583+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:21.593 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:21.585+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:21.605 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:21.596+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:22.239 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:22.231+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:22.269 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:16:22.262+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e226 v226) 2019-12-11T19:16:22.296 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:22.286+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:22.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:22.574+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:22.601 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:22.592+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:22.604 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:22.595+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:22.641 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:22.632+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:23.271 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:23.264+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:23.272 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:23.264+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:23.574 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:23.564+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:23.585 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:23.577+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:23.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:23.593+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:23.680 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:23.672+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:24.269 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:24.260+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:24.287 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:24.278+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:24.563 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:24.552+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:24.587 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:24.576+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:24.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:24.608+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:24.731 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:24.723+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:25.290 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:25.283+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:25.305 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:25.295+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:25.535 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:25.525+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:25.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:25.582+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:25.630 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:25.621+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:25.747 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:25.739+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:26.307 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:26.300+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:26.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:26.310+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:26.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:16:26.547+0000 1694f700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:04.774001+0000 front 2019-12-11T19:15:04.672323+0000 (oldest deadline 2019-12-11T19:15:49.959908+0000) 2019-12-11T19:16:26.566 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:26.555+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:26.610 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:26.600+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:16:26.721 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:16:26.712+0000 1694f700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.818669+0000 front 2019-12-11T19:15:07.801102+0000 (oldest deadline 2019-12-11T19:15:52.475782+0000) 2019-12-11T19:16:27.279 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:16:27.269+0000 1694f700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.543473+0000 front 2019-12-11T19:15:06.537718+0000 (oldest deadline 2019-12-11T19:15:49.362651+0000) 2019-12-11T19:16:27.309 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:16:27.303+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e226 v226) 2019-12-11T19:16:27.350 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:16:27.341+0000 1694f700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.425723+0000 front 2019-12-11T19:15:07.390472+0000 (oldest deadline 2019-12-11T19:15:50.161781+0000) 2019-12-11T19:16:27.599 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:16:27.590+0000 1694f700 -1 osd.5 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:06.793988+0000 front 2019-12-11T19:15:07.006601+0000 (oldest deadline 2019-12-11T19:16:01.835548+0000) 2019-12-11T19:16:27.644 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:16:27.635+0000 1694f700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:15:07.736696+0000 front 2019-12-11T19:15:07.741011+0000 (oldest deadline 2019-12-11T19:15:50.586625+0000) 2019-12-11T19:17:12.992 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:12.970+0000 35f8f700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:12.996 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:12.981+0000 3578e700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:13.100 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:13.083+0000 36f91700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:13.174 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:13.118+0000 36f91700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:13.323 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:13.199+0000 31f87700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:13.325 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:13.213+0000 31f87700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:13.331 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:13.228+0000 3578e700 -1 osd.2 231 build_incremental_map_msg missing incremental map 231 2019-12-11T19:17:23.966 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:23.957+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:25.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:24.999+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:25.335 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:25.326+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:25.515 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:25.508+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:26.003 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:25.996+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:26.053 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:26.043+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:26.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:26.173+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:26.357 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:26.348+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:26.539 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:26.532+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:26.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:26.957+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:27.014 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:27.006+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:27.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:27.209+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:27.361 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:27.354+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:27.590 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:27.582+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:27.729 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:27.720+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:27.966 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:27.958+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:28.023 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:28.014+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:28.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:28.220+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:28.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:28.389+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:28.631 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:28.624+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:28.726 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:28.718+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:28.967 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:28.960+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:29.012 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:29.005+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:29.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:29.213+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:29.373 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:29.366+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:29.666 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:29.658+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:29.681 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:29.673+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:29.979 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:29.970+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:30.005 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:29.996+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:30.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:30.216+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:30.407 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:30.399+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:30.695 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:30.687+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:30.709 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:30.702+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:30.998 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:30.991+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:31.026 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:31.019+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:31.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:31.254+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:31.365 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:31.357+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:31.654 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:31.646+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:31.705 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:31.698+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:31.990 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:31.982+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:32.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:32.005+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:32.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:32.256+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:32.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:32.391+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:32.677 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:32.669+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:32.707 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:32.700+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:32.990 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:32.982+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:33.031 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:33.024+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:33.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:33.236+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:33.373 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:33.365+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:33.663 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:33.653+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:33.707 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:33.698+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:33.989 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:33.982+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:34.066 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:34.060+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:34.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:34.217+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:34.364 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:34.356+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:34.705 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:34.698+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:34.708 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:34.699+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:34.987 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:34.979+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:35.098 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:35.091+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:35.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:35.238+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:35.349 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:35.340+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:35.703 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:35.695+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:35.746 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:35.738+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:36.027 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:36.019+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:36.060 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:36.051+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:36.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:36.207+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:36.330 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:36.322+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:36.668 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:36.659+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:36.755 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:36.747+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:36.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:36.978+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:37.027 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:37.020+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:37.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:37.182+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:37.319 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:37.311+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:37.700 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:37.692+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:37.725 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:37.719+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:38.035 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:38.027+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:38.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:38.069+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:38.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:38.227+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:38.369 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:38.361+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:38.744 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:38.736+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:38.776 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:38.769+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:39.037 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:39.029+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:39.072 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:39.065+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:39.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:39.222+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:39.392 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:39.385+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:39.768 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:39.761+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:39.772 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:39.764+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:40.038 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:40.030+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:40.121 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:40.114+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:40.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:40.271+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:40.376 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:40.368+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:40.744 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:40.737+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:40.798 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:40.790+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:41.039 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:41.031+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:41.133 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:41.126+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:41.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:41.243+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:41.420 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:41.412+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:41.707 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:41.699+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:41.827 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:41.819+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:42.000 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:41.994+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:42.086 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:42.078+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:42.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:42.139+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:42.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:42.283+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:42.377 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:42.369+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:42.720 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:42.713+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:42.869 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:42.861+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:42.979 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:42.972+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:43.080 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:43.072+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:43.164 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:43.158+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:43.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:43.278+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:43.363 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:43.354+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:43.673 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:43.666+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:43.830 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:43.822+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:43.972 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:43.965+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:44.072 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:44.063+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:44.169 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:44.162+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:44.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:44.259+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:44.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:44.312+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:44.659 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:44.651+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:44.812 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:44.805+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:44.991 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:44.984+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:45.105 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:45.097+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:45.132 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:45.125+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:45.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:45.222+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:45.280 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:45.272+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:45.618 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:45.611+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:45.776 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:45.768+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:46.037 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:46.031+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:46.120 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:46.112+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:46.174 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:46.167+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:46.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:46.261+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:46.280 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:46.270+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:46.610 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:46.603+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:46.740 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:46.732+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:47.062 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:47.055+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:47.150 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:47.143+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:47.166 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:47.157+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:47.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:47.239+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:47.263 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:47.255+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:47.619 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:47.612+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:47.741 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:47.733+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:48.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:48.082+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:48.148 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:48.140+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:48.197 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:48.190+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:48.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:48.219+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:48.292 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:48.284+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:48.581 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:48.574+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:48.709 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:48.700+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:49.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:49.082+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:49.143 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:49.136+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:49.221 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:49.213+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:49.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:49.223+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:49.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:49.317+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:49.606 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:49.600+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:49.673 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:49.664+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:50.141 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:50.116+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:50.141 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:50.117+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:50.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:50.140+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:50.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:50.195+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:50.276 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:50.268+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:50.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:50.284+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:50.592 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:50.584+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:50.707 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:50.699+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:51.091 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:51.082+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:51.092 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:51.084+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:51.156 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:51.148+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:51.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:51.185+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:51.290 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:51.282+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:51.312 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:51.305+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:51.566 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:51.558+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:51.697 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:51.689+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:52.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:52.082+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:52.092 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:52.085+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:52.180 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:52.172+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:52.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:52.180+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:52.259 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:52.251+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:52.267 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:52.260+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:52.533 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:52.525+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:52.746 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:52.739+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:53.086 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:53.077+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:53.086 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:53.080+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:53.145 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:53.136+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:53.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:53.168+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:53.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:53.283+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:53.308 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:53.300+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:53.533 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:53.525+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:53.718 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:53.711+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:54.076 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:54.069+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:54.078 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:54.071+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:54.125 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:54.114+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:54.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:54.178+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:54.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:54.274+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:54.290 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:54.282+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:54.498 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:54.490+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:54.764 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:54.756+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:55.127 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:55.120+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:55.128 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:55.121+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:55.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:55.137+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:55.149 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:55.142+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:55.276 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:55.268+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:55.298 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:55.290+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:55.487 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:55.480+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:55.770 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:55.763+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:56.103 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:56.097+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:56.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:56.154+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:56.178 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:56.169+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:56.178 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:56.171+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:56.264 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:56.256+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:56.288 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:56.280+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:56.538 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:56.531+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:56.801 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:56.792+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:57.077 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:57.069+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:57.134 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:57.127+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:57.137 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:57.130+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:57.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:57.175+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:57.228 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:57.220+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:57.319 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:57.311+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:57.495 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:57.488+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:57.708 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:17:57.701+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:17:57.760 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:57.753+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:58.097 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:58.090+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:58.128 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:58.118+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:58.128 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:58.120+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:58.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:58.187+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:58.243 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:58.235+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:58.368 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:58.360+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:58.489 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:58.481+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:58.800 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:58.792+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:17:59.076 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:17:59.070+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:17:59.108 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:59.099+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:17:59.109 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:17:59.101+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:17:59.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:17:59.162+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:17:59.253 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:17:59.243+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:17:59.358 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:17:59.350+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:17:59.468 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:17:59.461+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:17:59.765 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:17:59.756+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:00.070 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:00.064+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:00.072 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:00.066+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:00.095 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:00.088+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:00.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:00.122+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:00.254 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:00.246+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:00.383 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:00.375+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:00.458 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:00.451+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:00.760 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:00.752+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:01.051 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:01.042+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:01.053 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:01.044+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:01.127 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:01.120+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:01.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:01.121+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:01.226 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:01.218+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:01.360 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:01.352+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:01.433 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:01.425+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:01.813 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:01.806+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:02.070 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:02.061+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:02.071 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:02.064+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:02.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:02.143+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:02.154 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:02.148+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:02.241 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:02.231+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:02.365 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:02.356+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:02.428 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:02.421+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:02.726 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:02.717+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:02.800 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:02.791+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:03.028 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:03.019+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:03.030 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:03.021+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:03.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:03.146+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:03.201 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:03.194+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:03.227 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:03.218+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:03.413 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:03.403+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:03.465 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:03.457+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:03.845 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:03.835+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:04.059 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:04.050+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:04.060 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:04.053+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:04.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:04.104+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:04.227 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:04.217+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:04.251 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:04.243+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:04.411 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:04.401+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:04.495 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:04.488+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:04.843 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:04.834+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:05.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:05.104+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:05.114 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:05.107+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:05.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:05.155+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:05.213 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:05.206+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:05.271 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:05.254+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:05.444 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:05.435+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:05.522 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:05.514+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:05.817 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:05.808+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:06.116 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:06.108+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:06.118 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:06.109+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:06.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:06.117+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:06.215 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:06.207+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:06.255 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:06.246+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:06.434 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:06.425+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:06.500 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:06.492+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:06.863 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:06.851+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:07.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:07.108+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:07.168 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:07.160+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:07.173 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:07.165+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:07.261 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:07.253+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:07.290 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:07.281+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:07.422 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:07.414+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:07.459 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:07.451+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:07.746 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:07.737+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:07.906 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:07.896+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:08.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:08.117+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:08.172 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:08.162+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:08.174 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:08.164+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:08.272 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:08.263+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:08.348 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:08.337+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:08.417 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:08.409+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:08.426 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:08.417+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:08.868 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:08.859+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:09.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:09.072+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:09.175 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:09.164+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:09.175 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:09.166+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:09.325 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:09.317+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:09.336 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:09.327+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:09.407 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:09.399+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:09.453 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:09.446+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:09.828 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:09.820+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:10.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:10.063+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:10.210 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:10.203+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:10.215 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:10.207+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:10.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:10.282+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:10.364 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:10.357+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:10.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:10.406+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:10.440 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:10.433+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:10.819 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:10.810+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:11.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:11.070+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:11.194 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:11.185+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:11.195 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:11.187+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:11.278 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:11.269+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:11.378 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:11.370+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:11.408 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:11.401+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:11.442 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:11.436+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:11.845 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:11.836+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:12.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:12.046+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:12.239 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:12.231+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:12.239 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:12.233+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:12.254 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:12.245+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:12.384 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:12.375+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:12.455 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:12.447+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:12.459 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:12.452+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:12.759 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:12.751+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:12.886 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:12.878+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:13.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:13.010+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:13.219 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:13.212+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:13.220 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:13.213+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:13.266 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:13.257+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:13.391 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:13.382+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:13.459 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:13.451+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:13.478 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:13.471+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:13.884 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:13.875+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:14.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:14.015+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:14.185 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:14.176+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:14.186 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:14.179+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:14.305 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:14.286+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:14.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:14.379+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:14.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:14.484+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:14.504 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:14.497+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:14.882 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:14.873+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:14.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:14.972+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:15.161 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:15.154+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:15.164 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:15.156+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:15.336 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:15.328+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:15.411 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:15.403+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:15.512 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:15.505+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:15.519 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:15.512+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:15.856 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:15.847+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:15.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:15.966+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:16.173 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:16.159+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:16.173 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:16.160+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:16.311 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:16.303+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:16.445 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:16.437+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:16.485 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:16.477+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:16.569 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:16.562+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:16.874 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:16.864+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:17.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:17.012+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:17.184 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:17.176+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:17.185 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:17.178+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:17.287 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:17.279+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:17.426 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:17.418+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:17.504 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:17.496+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:17.530 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:17.524+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:17.778 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:17.768+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:17.882 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:17.875+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:17.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:17.980+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:18.166 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:18.158+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:18.167 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:18.160+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:18.278 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:18.269+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:18.437 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:18.429+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:18.464 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:18.457+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:18.522 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:18.515+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:18.880 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:18.871+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:19.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:19.026+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:19.123 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:19.116+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:19.128 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:19.121+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:19.316 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:19.297+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:19.413 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:19.405+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:19.433 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:19.425+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:19.505 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:19.497+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:19.886 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:19.879+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:20.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:20.041+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:20.108 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:20.100+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:20.109 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:20.102+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:20.261 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:20.252+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:20.432 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:20.424+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:20.469 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:20.462+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:20.525 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:20.518+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:20.903 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:20.895+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:21.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:20.998+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:21.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:21.107+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:21.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:21.108+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:21.229 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:21.221+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:21.406 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:21.397+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:21.514 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:21.506+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:21.575 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:21.568+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:21.896 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:21.887+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:22.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:22.020+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:22.122 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:22.115+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:22.126 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:22.117+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:22.183 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:22.175+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:22.360 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:22.352+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:22.504 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:22.496+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:22.616 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:22.608+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:22.797 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:22.788+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:22.861 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:22.853+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:23.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:23.030+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:23.127 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:23.120+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:23.130 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:23.123+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:23.171 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:23.163+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:23.320 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:23.311+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:23.506 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:23.499+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:23.621 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:23.613+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:23.821 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:23.813+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:24.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:24.065+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:24.099 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:24.091+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:24.101 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:24.092+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:24.150 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:24.142+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:24.337 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:24.329+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:24.543 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:24.535+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:24.604 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:24.597+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:24.806 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:24.790+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:25.087 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:25.080+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:25.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:25.081+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:25.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:25.105+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:25.127 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:25.119+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:25.317 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:25.309+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:25.555 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:25.548+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:25.598 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:25.590+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:25.851 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:25.843+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:26.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:26.105+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:26.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:26.106+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:26.147 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:26.139+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:26.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:26.152+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:26.358 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:26.350+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:26.526 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:26.519+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:26.588 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:26.582+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:26.837 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:26.828+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:27.083 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:27.074+0000 1694f700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:17:09.985874+0000 (oldest deadline 2019-12-11T19:17:49.985874+0000) 2019-12-11T19:18:27.084 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:27.076+0000 1694f700 -1 osd.2 232 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:27.136 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:18:27.128+0000 1694f700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.823615+0000 front 2019-12-11T19:16:43.475597+0000 (oldest deadline 2019-12-11T19:17:25.219254+0000) 2019-12-11T19:18:27.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:27.183+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:27.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:18:27.379+0000 1694f700 -1 osd.5 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:40.092668+0000 front 2019-12-11T19:16:39.930449+0000 (oldest deadline 2019-12-11T19:17:25.268893+0000) 2019-12-11T19:18:27.573 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:18:27.566+0000 1694f700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:44.414752+0000 front 2019-12-11T19:16:42.705523+0000 (oldest deadline 2019-12-11T19:17:24.930554+0000) 2019-12-11T19:18:27.599 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:18:27.592+0000 1694f700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.130435+0000 front 2019-12-11T19:16:44.091489+0000 (oldest deadline 2019-12-11T19:17:23.915068+0000) 2019-12-11T19:18:27.858 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:18:27.844+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e232 v232) 2019-12-11T19:18:27.883 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:18:27.873+0000 1694f700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:41.685504+0000 front 2019-12-11T19:16:41.822618+0000 (oldest deadline 2019-12-11T19:17:26.889177+0000) 2019-12-11T19:18:28.158 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:28.100+0000 31786700 -1 osd.2 233 build_incremental_map_msg missing incremental map 231 2019-12-11T19:18:28.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:28.235+0000 1694f700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:16:43.158208+0000 front 2019-12-11T19:16:43.161224+0000 (oldest deadline 2019-12-11T19:17:25.770663+0000) 2019-12-11T19:18:28.243 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:18:28.126+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e230) 2019-12-11T19:18:44.318 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:18:44.251+0000 21852700 -1 reset not still connected to 0x155a4bb0 2019-12-11T19:18:44.319 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:18:44.251+0000 21852700 -1 reset not still connected to 0x2241c3b0 2019-12-11T19:18:48.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:18:48.659+0000 124b0700 -1 osd.1 236 build_incremental_map_msg missing incremental map 236 2019-12-11T19:19:51.646 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:51.636+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:52.143 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:52.132+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:52.633 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:52.626+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:52.646 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:52.637+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:53.168 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:53.160+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:53.244 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:53.235+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:53.637 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:53.628+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:53.671 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:53.663+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:53.861 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:53.854+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:54.143 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:54.134+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:54.225 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:54.216+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:54.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:54.481+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:54.600 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:54.591+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:54.631 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:54.621+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:54.662 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:54.654+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:54.847 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:54.839+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:55.169 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:55.160+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:55.212 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:55.202+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:55.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:55.506+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:55.608 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:55.599+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:55.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:55.618+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:55.647 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:55.637+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:55.895 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:55.885+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:56.186 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:56.177+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:56.204 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:56.195+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:56.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:56.460+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:56.609 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:56.602+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:56.625 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:56.616+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:56.657 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:56.647+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:56.938 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:56.930+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:57.181 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:57.171+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:57.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:57.177+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:57.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:57.455+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:57.603 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:57.594+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:57.627 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:57.617+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:57.658 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:57.651+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:57.937 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:57.930+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:58.220 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:58.210+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:58.233 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:58.225+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:58.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:58.472+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:58.616 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:58.606+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:58.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:58.624+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:58.643 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:58.634+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:58.962 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:58.954+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:19:59.188 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:19:59.179+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:19:59.216 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:19:59.207+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:19:59.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:19:59.487+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:19:59.591 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:19:59.582+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:19:59.648 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:19:59.639+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:19:59.680 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:19:59.672+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:19:59.955 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:19:59.945+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:00.161 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:00.151+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:00.210 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:00.202+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:00.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:00.463+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:00.603 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:00.593+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:00.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:00.628+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:00.684 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:00.675+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:00.931 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:00.923+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:01.177 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:01.167+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:01.232 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:01.222+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:01.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:01.477+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:01.574 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:01.564+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:01.646 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:01.636+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:01.690 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:01.682+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:01.965 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:01.958+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:02.205 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:02.196+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:02.217 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:02.208+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:02.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:02.500+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:02.582 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:02.573+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:02.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:02.647+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:02.681 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:02.669+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:02.938 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:02.931+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:03.169 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:03.160+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:03.223 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:03.214+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:03.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:03.552+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:03.577 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:03.567+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:03.646 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:03.636+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:03.733 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:03.723+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:03.917 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:03.909+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:04.186 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:04.177+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:04.230 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:04.222+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:04.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:04.579+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:04.615 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:04.606+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:04.672 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:04.664+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:04.754 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:04.745+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:04.923 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:04.914+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:05.176 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:05.167+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:05.254 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:05.245+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:05.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:05.563+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:05.606 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:05.598+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:05.702 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:05.694+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:05.793 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:05.784+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:05.967 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:05.960+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:06.045 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:38:06.262 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.055 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:38:06.271 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.067 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:38:06.284 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.070 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:38:06.286 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.075 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:38:06.249 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.099 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:38:06.273 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.204 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:06.195+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:06.248 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:06.239+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:06.302 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:38:06.518 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.318 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:38:06.534 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.365 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:38:06.539 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:20:06.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:06.607+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:06.644 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:06.635+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:06.658 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:06.651+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:06.767 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:06.758+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:06.922 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:06.914+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:07.215 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:07.206+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:07.283 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:07.275+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:07.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:07.573+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:07.620 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:07.613+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:07.628 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:07.620+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:07.747 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:07.739+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:07.891 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:07.882+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:08.200 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:08.190+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:08.247 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:08.239+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:08.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:08.575+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:08.649 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:08.641+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:08.666 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:08.656+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:08.805 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:08.795+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:08.934 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:08.926+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:09.189 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:09.180+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:09.283 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:09.274+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:09.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:09.575+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:09.612 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:09.604+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:09.650 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:09.640+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:09.837 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:09.828+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:09.910 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:09.902+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:10.235 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:10.225+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:10.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:10.327+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:10.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:10.544+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:10.652 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:10.644+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:10.660 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:10.653+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:10.818 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:10.809+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:10.944 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:10.937+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:11.276 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:11.268+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:11.353 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:11.343+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:11.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:11.597+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:11.641 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:11.632+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:11.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:11.648+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:11.871 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:11.862+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:11.926 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:11.919+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:12.315 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:12.306+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:12.348 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:12.339+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:12.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:12.598+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:12.632 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:12.622+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:12.698 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:12.690+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:12.841 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:12.831+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:12.916 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:12.907+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:13.327 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:13.319+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:13.370 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:13.360+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:13.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:13.560+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:13.605 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:13.589+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:13.691 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:13.683+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:13.891 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:13.882+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:13.894 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:13.885+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:14.344 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:14.336+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:14.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:14.405+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:14.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:14.560+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:14.624 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:14.615+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:14.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:14.664+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:14.884 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:14.875+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:14.930 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:14.922+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:15.383 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:15.374+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:15.401 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:15.392+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:15.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:15.561+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:15.674 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:15.666+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:15.702 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:15.694+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:15.890 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:15.882+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:15.930 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:15.920+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:16.391 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:16.381+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:16.398 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:16.389+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:16.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:16.581+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:16.631 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:16.621+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:16.743 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:16.735+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:16.881 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:16.872+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:16.932 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:16.923+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:17.395 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:17.386+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:17.400 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:17.391+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:17.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:17.544+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:17.622 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:17.614+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:17.787 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:17.778+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:17.841 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:17.831+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:17.966 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:17.958+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:18.368 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:18.359+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:18.371 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:18.362+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:18.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:18.591+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:18.656 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:18.646+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:18.835 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:18.827+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:18.855 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:18.847+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:18.983 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:18.973+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:19.371 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:19.362+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:19.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:19.404+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:19.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:19.641+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:19.668 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:19.659+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:19.805 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:19.798+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:19.882 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:19.874+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:19.964 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:19.955+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:20.383 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:20.374+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:20.423 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:20.414+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:20.630 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:20.620+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:20.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:20.647+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:20.828 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:20.822+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:20.925 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:20.918+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:20.987 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:20.976+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:21.392 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:21.383+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:21.454 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:21.445+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:21.658 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:21.648+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:21.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:21.695+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:21.855 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:21.848+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:21.881 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:21.873+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:21.985 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:21.976+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:22.389 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:22.380+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:22.412 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:22.403+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:22.631 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:22.622+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:22.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:22.701+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:22.864 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:22.857+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:22.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:22.872+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:22.998 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:22.990+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:23.364 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:23.356+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:23.458 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:23.449+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:23.673 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:23.663+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:23.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:23.719+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:23.855 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:23.846+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:23.868 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:23.861+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:24.011 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:24.001+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:24.390 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:24.381+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:24.439 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:24.430+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:24.723 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:24.713+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:24.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:24.725+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:24.845 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:24.837+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:24.886 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:24.879+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:25.028 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:25.019+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:25.394 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:25.385+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:25.476 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:25.466+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:25.713 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:25.704+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:25.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:25.756+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:25.858 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:25.852+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:25.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:25.870+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:26.009 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:26.001+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:26.397 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:26.387+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:26.455 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:26.443+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:26.729 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:26.720+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:26.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:26.734+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:26.828 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:26.820+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:26.878 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:26.870+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:27.027 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:27.019+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:27.392 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:27.383+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:27.423 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:27.414+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:27.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:27.709+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:27.720 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:27.712+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:27.804 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:27.796+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:27.908 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:27.900+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:28.004 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:27.995+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:28.257 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:20:28.250+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e238 v238) 2019-12-11T19:20:28.433 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:28.423+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:28.470 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:28.460+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:28.705 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:28.696+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:28.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:28.757+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:28.854 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:28.846+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:28.875 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:28.867+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:29.061 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:29.050+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:29.441 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:29.430+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:29.488 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:29.477+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:29.688 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:29.677+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:29.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:29.766+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:29.847 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:29.838+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:29.849 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:29.841+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:30.095 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:30.085+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:30.453 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:30.443+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:30.539 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:30.529+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:30.648 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:30.638+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:30.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:30.739+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:30.812 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:30.805+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:30.825 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:30.817+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:31.085 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:31.074+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:31.483 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:31.474+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:31.525 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:31.515+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:31.682 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:31.672+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:31.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:31.698+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:31.794 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:31.787+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:31.829 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:31.822+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:32.107 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:32.097+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:32.532 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:32.521+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:32.552 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:20:32.542+0000 1694f700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108450+0000 front 2019-12-11T19:19:08.965389+0000 (oldest deadline 2019-12-11T19:19:51.814418+0000) 2019-12-11T19:20:32.665 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:32.655+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:32.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:20:32.745+0000 1694f700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.108742+0000 front 2019-12-11T19:19:09.143656+0000 (oldest deadline 2019-12-11T19:19:54.159190+0000) 2019-12-11T19:20:32.824 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:20:32.817+0000 1694f700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.647742+0000 front 2019-12-11T19:19:08.653285+0000 (oldest deadline 2019-12-11T19:19:52.258342+0000) 2019-12-11T19:20:32.833 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:32.825+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:33.089 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:20:33.079+0000 1694f700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.792889+0000 front 2019-12-11T19:19:08.602680+0000 (oldest deadline 2019-12-11T19:19:54.395522+0000) 2019-12-11T19:20:33.310 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:20:33.301+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e238 v238) 2019-12-11T19:20:33.549 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:33.541+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:20:33.669 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:20:33.659+0000 1694f700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:06.304430+0000 front 2019-12-11T19:19:06.373531+0000 (oldest deadline 2019-12-11T19:19:50.941602+0000) 2019-12-11T19:20:33.821 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:20:33.814+0000 1694f700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:09.196356+0000 front 2019-12-11T19:19:09.168239+0000 (oldest deadline 2019-12-11T19:19:53.824893+0000) 2019-12-11T19:20:34.572 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:20:34.561+0000 1694f700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:19:08.281051+0000 front 2019-12-11T19:19:08.335117+0000 (oldest deadline 2019-12-11T19:19:52.240242+0000) 2019-12-11T19:21:30.446 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:30.439+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:31.335 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:31.328+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:31.501 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:31.493+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:31.641 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:31.633+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:32.125 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:32.118+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:32.337 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:32.330+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:32.524 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:32.516+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:32.648 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:32.640+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:32.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:32.804+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:33.157 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:33.150+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:33.317 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:33.310+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:33.511 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:33.503+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:33.614 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:33.607+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:33.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:33.764+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:34.123 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:34.116+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:34.189 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:34.180+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:34.287 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:34.280+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:34.496 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:34.488+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:34.577 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:34.570+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:34.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:34.770+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:35.165 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:35.158+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:35.200 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:35.192+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:35.262 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:35.251+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:35.473 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:35.464+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:35.578 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:35.569+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:35.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:35.814+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:36.182 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:36.173+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:36.213 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:36.206+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:36.262 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:36.254+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:36.482 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:36.474+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:36.579 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:36.570+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:36.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:36.791+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:37.209 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:37.201+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:37.221 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:37.215+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:37.295 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:37.289+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:37.440 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:37.432+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:37.631 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:37.622+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:37.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:37.838+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:38.173 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:38.163+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:38.263 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:38.256+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:38.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:38.339+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:38.422 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:38.415+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:38.672 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:38.664+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:38.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:38.845+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:39.224 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:39.216+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:39.261 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:39.255+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:39.373 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:39.366+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:39.443 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:39.435+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:39.672 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:39.664+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:39.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:39.855+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:40.220 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:40.213+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:40.258 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:40.250+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:40.424 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:40.416+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:40.477 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:40.469+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:40.720 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:40.707+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:40.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:40.907+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:41.256 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:41.249+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:41.265 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:41.258+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:41.288 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:41.279+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:41.385 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:41.374+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:41.455 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:41.447+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:41.723 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:41.715+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:41.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:41.904+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:42.215 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:42.208+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:42.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:42.257+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:42.269 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:42.262+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:42.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:42.338+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:42.417 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:42.409+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:42.777 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:42.768+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:42.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:42.917+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:43.171 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:43.162+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:43.250 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:43.242+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:43.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:43.289+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:43.351 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:43.343+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:43.435 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:43.426+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:43.740 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:43.732+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:43.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:43.892+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:44.142 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:44.133+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:44.265 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:44.256+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:44.297 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:44.289+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:44.399 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:44.390+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:44.431 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:44.422+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:44.712 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:44.705+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:44.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:44.917+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:45.110 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:45.101+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:45.256 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:45.248+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:45.344 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:45.335+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:45.367 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:45.358+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:45.410 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:45.402+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:45.697 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:45.689+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:45.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:45.961+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:46.127 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:46.118+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:46.276 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:46.267+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:46.313 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:46.305+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:46.350 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:46.341+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:46.420 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:46.411+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:46.669 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:46.661+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:46.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:46.926+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:47.081 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:47.074+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:47.247 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:47.239+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:47.321 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:47.314+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:47.330 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:47.322+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:47.420 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:47.413+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:47.688 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:47.681+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:47.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:47.912+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:48.124 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:48.117+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:48.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:48.291+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:48.358 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:48.351+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:48.359 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:48.350+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:48.473 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:48.465+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:48.657 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:48.648+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:48.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:48.918+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:49.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:49.148+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:49.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:49.306+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:49.323 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:49.317+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:49.385 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:49.378+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:49.457 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:49.449+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:49.665 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:49.658+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:49.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:49.881+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:50.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:50.106+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:50.116 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:50.108+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:50.291 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:50.284+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:50.312 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:50.305+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:50.432 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:50.424+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:50.442 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:50.434+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:50.680 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:50.671+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:50.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:50.908+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:51.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:51.105+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:51.116 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:51.108+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:51.281 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:51.273+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:51.339 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:51.331+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:51.441 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:51.433+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:51.492 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:51.484+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:51.656 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:51.648+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:51.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:51.904+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:52.104 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:52.097+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:52.108 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:52.100+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:52.301 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:52.294+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:52.322 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:52.314+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:52.405 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:52.398+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:52.545 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:52.537+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:52.697 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:52.688+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:52.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:52.924+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:53.096 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:53.088+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:53.097 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:53.090+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:53.273 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:53.266+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:53.322 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:53.314+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:53.409 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:53.401+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:53.512 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:53.504+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:53.656 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:53.648+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:53.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:53.964+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:54.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:54.080+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:54.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:54.083+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:54.284 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:54.276+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:54.324 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:54.317+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:54.373 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:54.366+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:54.480 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:54.472+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:54.676 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:54.669+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:55.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:55.016+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:55.073 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:55.066+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:55.077 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:55.069+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:55.277 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:55.270+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:55.290 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:55.282+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:55.355 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:55.348+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:55.439 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:55.430+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:55.665 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:55.657+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:56.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:56.019+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:56.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:56.106+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:56.114 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:56.108+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:56.272 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:56.263+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:56.275 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:56.267+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:56.368 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:56.360+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:56.434 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:56.425+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:56.699 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:56.691+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:57.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:57.040+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:57.167 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:57.160+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:57.170 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:57.163+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:57.269 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:57.262+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:57.295 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:57.288+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:57.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:57.396+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:57.468 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:57.460+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:57.719 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:57.710+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:58.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:58.046+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:58.203 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:58.195+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:58.204 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:58.197+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:58.315 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:58.307+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:58.336 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:58.328+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:58.429 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:58.422+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:58.473 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:58.465+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:58.718 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:58.710+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:21:59.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:21:59.057+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:21:59.190 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:59.180+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:21:59.192 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:21:59.183+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:21:59.363 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:21:59.355+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:21:59.370 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:21:59.362+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:21:59.451 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:21:59.443+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:21:59.461 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:21:59.452+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:21:59.727 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:21:59.719+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:00.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:00.016+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:00.159 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:00.151+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:00.166 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:00.159+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:00.335 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:00.327+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:00.370 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:00.362+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:00.440 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:00.432+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:00.442 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:00.434+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:00.723 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:00.714+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:01.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:01.019+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:01.137 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:01.128+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:01.138 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:01.131+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:01.322 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:01.315+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:01.368 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:01.361+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:01.423 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:01.415+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:01.430 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:01.423+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:01.713 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:01.705+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:02.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:02.060+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:02.130 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:02.122+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:02.131 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:02.124+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:02.352 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:02.344+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:02.376 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:02.368+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:02.401 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:02.394+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:02.428 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:02.420+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:02.668 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:02.660+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:03.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:03.084+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:03.178 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:03.170+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:03.179 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:03.172+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:03.331 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:03.324+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:03.334 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:03.327+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:03.373 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:03.366+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:03.385 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:03.378+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:03.586 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:22:03.574+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e245 v245) 2019-12-11T19:22:03.712 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:03.704+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:04.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:04.123+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:04.212 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:04.205+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:04.213 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:04.206+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:04.287 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:04.280+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:04.341 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:04.333+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:04.381 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:04.373+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:04.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:04.391+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:04.681 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:04.673+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:05.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:05.153+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:05.170 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:05.162+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:05.171 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:05.163+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:05.329 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:05.322+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:05.341 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:05.334+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:05.361 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:05.353+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:05.371 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:05.364+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:05.645 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:05.635+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:06.190 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:06.182+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:06.191 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:06.184+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:06.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:06.199+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:06.356 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:06.346+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:06.363 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:06.356+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:06.371 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:06.363+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:06.406 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:06.397+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:06.614 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:06.603+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:07.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:07.221+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:07.234 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:07.226+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:07.236 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:07.228+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:07.322 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:07.313+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:07.344 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:07.333+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:07.345 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:07.338+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:07.393 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:07.383+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:07.669 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:07.660+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:08.207 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:08.201+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:08.211 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:08.204+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:08.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:08.227+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:08.329 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:08.320+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:08.336 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:08.329+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:08.357 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:08.350+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:08.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:08.390+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:08.601 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:22:08.594+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e245 v245) 2019-12-11T19:22:08.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:08.667+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:09.181 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:09.173+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:09.183 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:09.175+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:09.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:09.235+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:09.362 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:09.353+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:09.372 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:09.366+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:09.385 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:09.378+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:09.423 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:09.414+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:09.692 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:09.682+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:10.169 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:10.160+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:10.170 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:10.162+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:10.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:10.257+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:10.348 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:10.342+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:10.365 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:10.358+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:10.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:10.371+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:10.468 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:10.459+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:10.741 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:10.732+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:11.197 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:11.189+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:11.200 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:11.191+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:11.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:11.293+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:11.325 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:11.317+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:11.348 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:11.339+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:11.411 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:11.404+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:11.487 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:11.478+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:11.759 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:11.750+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:12.169 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:12.162+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:12.174 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:12.167+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:12.306 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:12.299+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:12.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:12.315+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:12.344 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:12.336+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:12.405 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:12.398+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:12.495 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:12.486+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:12.794 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:12.785+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:13.134 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:13.126+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:13.135 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:13.128+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:13.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:13.319+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:13.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:13.339+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:13.360 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:13.352+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:13.457 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:13.448+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:13.458 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:13.451+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:13.619 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:22:13.609+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e245 v245) 2019-12-11T19:22:13.755 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:13.745+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:14.132 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:14.126+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:14.136 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:14.129+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:14.318 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:14.309+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:14.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:14.373+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:14.382 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:14.376+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:14.436 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:14.427+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:14.509 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:14.502+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:14.805 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:14.794+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:15.103 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:15.096+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:15.107 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:15.099+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:15.299 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:15.290+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:15.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:15.346+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:15.354 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:15.346+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:15.457 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:15.448+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:15.488 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:15.480+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:15.823 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:15.813+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:16.085 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:16.079+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:16.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:16.083+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:16.318 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:16.309+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:16.362 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:16.354+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:16.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:16.367+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:16.498 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:16.489+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:16.502 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:16.495+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:16.824 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:16.812+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:17.126 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:17.119+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:17.130 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:17.123+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:17.324 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:17.314+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:17.340 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:17.332+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:17.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:17.383+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:17.517 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:17.507+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:17.553 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:17.545+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:17.791 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:22:17.782+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.374317+0000 front 2019-12-11T19:20:46.615971+0000 (oldest deadline 2019-12-11T19:21:31.631568+0000) 2019-12-11T19:22:18.127 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:18.120+0000 1694f700 -1 osd.2 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:21:04.121090+0000 (oldest deadline 2019-12-11T19:21:49.755120+0000) 2019-12-11T19:22:18.132 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:22:18.124+0000 1694f700 -1 osd.2 245 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e243) 2019-12-11T19:22:18.320 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:22:18.312+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:49.597257+0000 front 2019-12-11T19:20:49.944604+0000 (oldest deadline 2019-12-11T19:21:33.653320+0000) 2019-12-11T19:22:18.325 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:22:18.318+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:44.863727+0000 front 2019-12-11T19:20:44.990936+0000 (oldest deadline 2019-12-11T19:21:30.462840+0000) 2019-12-11T19:22:18.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:22:18.359+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:46.539077+0000 front 2019-12-11T19:20:46.544395+0000 (oldest deadline 2019-12-11T19:21:32.042966+0000) 2019-12-11T19:22:18.515 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:22:18.507+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:47.480790+0000 front 2019-12-11T19:20:47.071762+0000 (oldest deadline 2019-12-11T19:21:31.893457+0000) 2019-12-11T19:22:18.536 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:22:18.528+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:20:50.333485+0000 front 2019-12-11T19:20:46.706596+0000 (oldest deadline 2019-12-11T19:21:30.037533+0000) 2019-12-11T19:22:18.695 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:22:18.688+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e245 v245) 2019-12-11T19:23:52.117 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:52.106+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:52.333 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:52.323+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:52.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:52.363+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:52.730 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:52.723+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:53.045 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:53.035+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:53.090 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:53.080+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:53.386 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:53.376+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:53.389 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:53.379+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:53.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:53.404+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:53.710 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:53.700+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:54.010 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:54.000+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:54.094 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:54.084+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:54.390 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:54.381+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:54.404 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:54.393+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:54.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:54.432+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:54.759 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:54.750+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:54.874 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:54.864+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:23:55.029 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:55.019+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:55.120 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:55.109+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:55.398 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:55.390+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:55.449 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:55.440+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:55.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:55.472+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:55.811 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:55.802+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:55.868 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:55.859+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:23:56.045 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:56.032+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:56.109 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:56.099+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:56.373 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:56.365+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:56.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:56.434+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:56.451 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:56.442+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:56.826 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:56.816+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:23:56.860 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:56.852+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:57.083 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:57.073+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:57.128 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:57.120+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:57.358 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:57.351+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:57.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:57.400+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:57.409 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:57.400+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:57.833 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:57.826+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:57.868 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:57.859+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:23:58.128 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:58.120+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:58.132 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:58.124+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:58.330 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:58.322+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:58.408 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:58.398+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:58.442 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:41:58.659 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:58.440+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:58.455 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:41:58.671 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.460 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:41:58.676 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.465 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:41:58.681 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.471 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:41:58.644 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.478 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:41:58.651 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.758 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:41:58.931 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.759 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:41:58.975 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.764 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:41:58.980 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:23:58.838 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:58.831+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:58.906 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:58.897+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:23:59.133 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:23:59.125+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:23:59.177 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:23:59.169+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:23:59.319 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:23:59.312+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:23:59.439 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:23:59.430+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:23:59.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:23:59.471+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:23:59.821 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:23:59.814+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:23:59.913 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:23:59.903+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:00.149 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:00.141+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:00.184 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:00.175+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:00.300 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:00.293+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:00.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:00.470+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:00.492 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:00.483+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:00.777 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:00.770+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:00.941 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:00.928+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:01.161 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:01.151+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:01.241 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:01.227+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:01.345 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:01.335+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:01.460 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:01.451+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:01.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:01.473+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:01.811 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:01.804+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:01.915 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:01.901+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:02.212 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:02.203+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:02.279 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:02.270+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:02.387 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:02.378+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:02.482 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:02.473+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:02.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:02.483+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:02.766 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:02.759+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:02.896 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:02.888+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:03.185 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:03.175+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:03.299 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:03.290+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:03.412 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:03.404+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:03.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:03.482+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:03.537 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:03.526+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:03.729 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:03.722+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:03.878 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:03.868+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:04.216 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:04.208+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:04.269 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:04.260+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:04.396 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:04.388+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:04.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:04.481+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:04.552 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:04.542+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:04.741 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:04.734+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:04.852 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:04.842+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:05.202 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:05.194+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:05.243 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:05.234+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:05.352 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:05.344+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:05.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:05.462+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:05.543 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:05.534+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:05.767 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:05.760+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:05.901 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:05.893+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:06.214 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:06.205+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:06.255 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:06.246+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:06.363 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:06.356+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:06.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:06.428+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:06.556 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:06.547+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:06.793 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:06.785+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:06.929 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:06.919+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:07.240 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:07.231+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:07.306 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:07.291+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:07.371 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:07.363+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:07.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:07.390+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:07.604 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:07.596+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:07.838 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:07.829+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:07.960 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:07.952+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:08.208 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:08.199+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:08.298 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:08.289+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:08.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:08.381+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:08.419 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:08.411+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:08.615 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:08.607+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:08.814 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:08.807+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:08.932 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:08.923+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:09.194 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:09.185+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:09.256 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:09.247+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:09.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:09.430+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:09.461 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:09.453+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:09.584 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:09.575+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:09.836 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:09.829+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:09.930 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:09.920+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:10.241 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:10.228+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:10.251 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:10.243+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:10.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:10.445+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:10.478 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:10.471+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:10.588 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:10.579+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:10.865 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:10.856+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:10.947 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:10.938+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:11.235 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:11.226+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:11.250 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:11.241+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:11.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:11.437+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:11.464 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:11.456+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:11.568 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:11.558+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:11.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:11.872+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:11.999 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:11.989+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:12.242 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:12.233+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:12.268 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:12.258+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:12.446 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:12.438+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:12.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:12.480+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:12.524 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:12.514+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:12.923 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:12.916+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:12.993 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:12.984+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:13.219 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:13.205+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:13.259 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:13.250+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:13.438 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:13.431+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:13.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:13.449+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:13.494 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:13.484+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:13.912 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:13.904+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:14.046 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:14.038+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:14.175 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:14.166+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:14.264 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:14.255+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:14.412 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:14.404+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:14.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:14.451+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:14.500 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:14.491+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:14.924 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:14.911+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:15.085 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:15.075+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:15.172 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:15.163+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:15.250 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:15.242+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:15.396 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:15.386+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:15.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:15.493+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:15.553 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:15.544+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:15.965 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:15.958+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:16.134 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:16.126+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:16.172 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:16.164+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:16.299 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:16.291+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:16.379 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:16.371+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:16.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:16.518+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:16.532 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:16.523+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:17.013 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:17.005+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:17.091 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:17.082+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:17.190 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:17.180+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:17.311 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:17.302+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:17.402 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:17.395+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:17.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:17.495+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:17.537 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:17.527+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:18.046 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:18.038+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:18.145 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:18.136+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:18.169 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:18.160+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:18.276 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:18.268+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:18.425 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:18.418+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:18.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:18.492+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:18.519 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:18.509+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:19.002 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:18.994+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:19.137 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:19.128+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:19.173 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:19.165+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:19.341 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:19.320+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:19.445 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:19.437+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:19.491 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:19.481+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:19.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:19.515+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:19.972 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:19.964+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:20.145 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:20.136+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:20.215 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:20.205+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:20.343 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:20.334+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:20.447 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:20.440+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:20.500 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:20.491+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:20.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:20.523+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:21.022 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:21.013+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:21.169 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:21.160+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:21.203 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:21.195+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:21.376 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:21.366+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:21.453 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:21.445+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:21.465 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:21.454+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:21.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:21.545+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:22.034 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:22.027+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:22.151 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:22.141+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:22.173 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:22.163+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:22.363 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:22.354+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:22.457 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:22.449+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:22.474 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:22.466+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:22.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:22.535+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:23.063 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:23.055+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:23.111 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:23.102+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:23.181 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:23.172+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:23.347 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:23.338+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:23.461 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:23.452+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:23.502 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:23.495+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:23.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:23.562+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:24.041 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:24.033+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:24.091 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:24.082+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:24.099 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:24:24.081+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e251 v251) 2019-12-11T19:24:24.203 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:24.193+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:24.308 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:24.300+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:24.434 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:24.425+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:24.504 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:24.497+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:24.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:24.605+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:25.054 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:25.046+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:25.075 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:25.065+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:25.236 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:25.227+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:25.279 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:25.270+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:25.484 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:25.475+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:25.547 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:25.540+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:25.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:25.621+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:26.074 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:26.066+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:26.094 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:26.088+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:26.213 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:26.204+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:26.267 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:26.247+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:26.457 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:26.449+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:26.529 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:26.522+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:26.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:26.666+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:27.053 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:27.043+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:27.112 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:27.105+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:27.212 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:27.202+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:27.273 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:27.262+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:27.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:27.483+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:27.501 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:27.492+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:27.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:27.622+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:28.096 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:28.087+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:28.130 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:28.123+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:28.168 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:28.159+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:28.301 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:28.289+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:28.459 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:28.450+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:28.469 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:28.460+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:28.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:28.628+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:29.109 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:24:29.101+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e251 v251) 2019-12-11T19:24:29.113 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:29.103+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:29.139 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:29.131+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:29.199 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:29.189+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:29.341 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:29.332+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:29.475 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:29.465+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:29.510 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:29.502+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:29.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:29.642+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:30.135 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:30.128+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:30.142 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:30.133+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:30.248 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:30.240+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:30.300 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:30.292+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:30.438 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:30.429+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:30.544 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:30.537+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:30.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:30.614+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:31.150 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:31.142+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:31.167 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:31.157+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:31.282 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:31.273+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:31.299 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:31.289+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:31.456 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:31.446+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:31.555 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:31.546+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:31.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:31.584+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:32.146 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:32.139+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:32.218 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:32.208+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:32.304 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:32.294+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:32.313 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:32.304+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:32.475 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:32.465+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:32.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:32.562+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:32.581 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:32.573+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:33.128 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:33.120+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:33.237 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:33.227+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:33.344 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:24:33.333+0000 1694f700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:09.738910+0000 front 2019-12-11T19:23:09.766937+0000 (oldest deadline 2019-12-11T19:23:51.997586+0000) 2019-12-11T19:24:33.357 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:33.347+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:33.479 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:24:33.469+0000 1694f700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:07.650683+0000 front 2019-12-11T19:23:07.514160+0000 (oldest deadline 2019-12-11T19:23:52.092700+0000) 2019-12-11T19:24:33.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:33.570+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:24:33.603 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:24:33.596+0000 1694f700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.822600+0000 front 2019-12-11T19:23:11.685405+0000 (oldest deadline 2019-12-11T19:23:53.362853+0000) 2019-12-11T19:24:34.110 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:24:34.103+0000 1694f700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:08.834742+0000 front 2019-12-11T19:23:08.907031+0000 (oldest deadline 2019-12-11T19:23:52.493708+0000) 2019-12-11T19:24:34.161 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:24:34.148+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e251 v251) 2019-12-11T19:24:34.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:24:34.229+0000 1694f700 -1 osd.4 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.491175+0000 front 2019-12-11T19:23:10.552893+0000 (oldest deadline 2019-12-11T19:23:52.116359+0000) 2019-12-11T19:24:34.335 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:24:34.326+0000 1694f700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:11.176889+0000 front 2019-12-11T19:23:11.087159+0000 (oldest deadline 2019-12-11T19:23:54.382701+0000) 2019-12-11T19:24:34.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:24:34.590+0000 1694f700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:23:10.637448+0000 front 2019-12-11T19:23:11.086931+0000 (oldest deadline 2019-12-11T19:23:52.321905+0000) 2019-12-11T19:25:32.315 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:32.305+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:32.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:32.515+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:32.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:32.677+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:33.328 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:33.320+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:33.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:33.561+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:33.677 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:33.671+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:34.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:34.318+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:34.493 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:34.486+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:34.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:34.555+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:34.703 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:34.696+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:34.849 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:34.841+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:35.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:35.318+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:35.419 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:35.411+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:35.453 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:35.445+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:35.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:35.607+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:35.753 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:35.745+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:35.891 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:35.881+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:36.313 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:36.305+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:36.440 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:36.434+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:36.459 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:36.451+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:36.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:36.647+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:36.790 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:36.782+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:36.931 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:36.923+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:37.277 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:37.270+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:37.476 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:37.468+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:37.501 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:37.492+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:37.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:37.661+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:37.811 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:37.803+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:37.985 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:37.977+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:38.333 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:38.324+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:38.479 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:38.472+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:38.546 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:38.538+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:38.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:38.657+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:38.848 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:38.841+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:38.957 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:38.949+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:39.307 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:39.297+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:39.520 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:39.513+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:39.537 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:39.529+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:39.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:39.707+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:39.883 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:39.876+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:39.972 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:39.964+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:40.345 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:40.336+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:40.553 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:40.546+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:40.577 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:40.568+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:40.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:40.662+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:40.871 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:40.864+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:40.988 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:40.980+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:41.355 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:41.347+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:41.547 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:41.539+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:41.585 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:41.577+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:41.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:41.662+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:41.866 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:41.859+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:41.989 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:41.982+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:42.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:42.394+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:42.557 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:42.544+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:42.583 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:42.577+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:42.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:42.651+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:42.829 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:42.822+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:42.993 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:42.985+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:43.425 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:43.416+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:43.515 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:43.507+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:43.558 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:43.551+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:43.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:43.681+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:43.854 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:43.847+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:44.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:44.005+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:44.478 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:44.470+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:44.531 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:44.522+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:44.562 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:44.554+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:44.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:44.638+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:44.863 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:44.855+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:45.027 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:45.019+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:45.447 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:45.438+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:45.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:45.502+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:45.544 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:45.536+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:45.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:45.662+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:45.781 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:45.773+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:45.916 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:45.909+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:46.006 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:45.998+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:46.451 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:46.443+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:46.538 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:46.530+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:46.549 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:46.542+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:46.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:46.716+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:46.766 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:46.758+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:46.919 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:46.912+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:47.055 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:47.043+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:47.467 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:47.459+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:47.540 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:47.532+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:47.588 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:47.581+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:47.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:47.749+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:47.811 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:47.804+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:47.967 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:47.961+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:48.035 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:48.027+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:48.466 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:48.455+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:48.498 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:48.490+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:48.591 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:48.584+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:48.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:48.742+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:48.831 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:48.823+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:48.922 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:48.915+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:49.020 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:49.011+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:49.436 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:49.428+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:49.470 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:49.462+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:49.505 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:43:49.722 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.539 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:43:49.756 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.554 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:43:49.770 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.568 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:43:49.742 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.570 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:43:49.744 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.574 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:49.567+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:49.582 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:43:49.798 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.656 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:43:49.872 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.676 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:43:49.850 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.679 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:43:49.896 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:25:49.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:49.724+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:49.833 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:49.826+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:49.937 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:49.930+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:50.017 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:50.008+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:50.418 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:50.409+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:50.506 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:50.496+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:50.594 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:50.583+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:50.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:50.751+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:50.883 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:50.876+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:50.969 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:50.962+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:50.970 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:50.962+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:51.397 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:51.387+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:51.542 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:51.534+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:51.642 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:51.620+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:51.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:51.752+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:51.860 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:51.853+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:51.950 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:51.943+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:51.971 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:51.962+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:52.369 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:52.361+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:52.513 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:52.505+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:52.604 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:52.597+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:52.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:52.803+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:52.827 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:52.817+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:52.828 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:52.820+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:52.947 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:52.939+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:52.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:52.956+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:53.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:53.319+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:53.516 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:53.508+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:53.625 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:53.618+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:53.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:53.815+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:53.823 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:53.817+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:53.828 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:53.821+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:53.918 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:53.911+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:53.975 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:53.967+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:54.289 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:54.280+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:54.473 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:54.465+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:54.657 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:54.650+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:54.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:54.794+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:54.843 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:54.831+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:54.843 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:54.834+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:54.937 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:54.928+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:54.947 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:54.939+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:55.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:55.323+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:55.479 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:55.470+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:55.702 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:55.695+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:55.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:55.754+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:55.879 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:55.872+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:55.880 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:55.873+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:55.931 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:55.923+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:55.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:55.956+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:56.376 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:56.368+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:56.515 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:56.507+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:56.752 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:56.745+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:56.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:56.771+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:56.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:56.910+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:56.920 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:56.911+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:56.933 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:56.926+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:56.982 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:56.973+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:57.386 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:57.379+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:57.483 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:57.475+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:57.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:57.748+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:57.782 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:57.776+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:57.899 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:57.893+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:57.956 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:57.948+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:57.964 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:57.957+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:57.968 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:57.961+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:58.398 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:58.389+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:58.467 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:58.460+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:58.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:58.793+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:58.834 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:58.827+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:58.872 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:58.866+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:58.985 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:58.976+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:25:59.023 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:59.013+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:25:59.024 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:25:59.016+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:25:59.382 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:25:59.372+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:25:59.498 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:25:59.490+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:25:59.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:25:59.768+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:25:59.853 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:25:59.846+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:25:59.921 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:25:59.913+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:25:59.963 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:25:59.955+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:00.076 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:00.069+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:00.081 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:00.073+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:00.387 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:00.379+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:00.503 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:00.495+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:00.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:00.748+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:00.844 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:00.837+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:00.951 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:00.942+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:00.995 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:00.985+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:01.112 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:01.103+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:01.114 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:01.105+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:01.350 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:01.341+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:01.476 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:01.467+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:01.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:01.724+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:01.799 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:01.792+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:01.913 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:01.906+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:01.953 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:01.944+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:02.087 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:02.080+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:02.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:02.081+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:02.305 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:02.297+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:02.436 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:02.424+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:02.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:02.691+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:02.783 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:02.776+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:02.907 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:02.900+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:02.965 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:02.953+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:03.133 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:03.124+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:03.134 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:03.126+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:03.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:03.283+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:03.418 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:03.406+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:03.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:03.654+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:03.784 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:03.777+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:03.916 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:03.908+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:03.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:03.978+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:04.132 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:04.123+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:04.140 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:04.124+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:04.289 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:04.282+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:04.382 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:04.375+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:04.535 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:04.524+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:04.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:04.635+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:04.819 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:04.811+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:04.901 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:04.893+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:04.974 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:04.966+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:05.130 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:05.120+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:05.131 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:05.123+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:05.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:05.312+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:05.397 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:05.389+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:05.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:05.597+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:05.815 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:05.807+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:05.888 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:05.880+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:05.954 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:05.945+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:06.150 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:06.141+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:06.151 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:06.143+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:06.295 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:06.286+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:06.438 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:06.430+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:06.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:06.585+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:06.844 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:06.835+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:06.914 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:06.906+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:07.014 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:06.996+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:07.116 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:07.107+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:07.118 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:07.108+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:07.311 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:07.303+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:07.398 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:07.390+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:07.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:07.636+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:07.861 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:07.850+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:07.971 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:07.963+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:08.024 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:08.015+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:08.138 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:08.130+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:08.139 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:08.131+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:08.361 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:08.352+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:08.439 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:08.430+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:08.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:08.597+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:08.852 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:08.844+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:08.978 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:08.970+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:08.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:08.977+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:09.150 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:09.142+0000 1694f700 -1 osd.2 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:25:12.342168+0000 (oldest deadline 2019-12-11T19:25:52.342168+0000) 2019-12-11T19:26:09.154 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:09.145+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:09.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:09.394+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:09.450 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:09.441+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:09.545 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:09.537+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:09.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:09.561+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:09.896 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:09.889+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:09.951 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:09.943+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:09.974 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:09.967+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:10.158 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:10.150+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:10.382 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:10.373+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:10.459 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:10.448+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:10.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:10.605+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:10.912 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:10.905+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:10.961 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:10.951+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:10.994 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:10.985+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:11.182 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:11.175+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:11.395 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:11.386+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:11.509 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:11.500+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:11.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:11.594+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:11.918 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:11.910+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:11.965 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:11.958+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:11.994 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:11.984+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:12.202 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:12.195+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:12.380 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:12.371+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:12.503 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:12.493+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:12.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:12.638+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:12.926 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:12.920+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:13.006 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:12.997+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:13.021 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:13.013+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:13.199 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:13.190+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:13.345 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:13.335+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:13.551 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:13.541+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:13.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:13.623+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:13.961 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:13.954+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:13.964 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:13.956+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:14.066 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:14.059+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:14.251 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:14.243+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:14.321 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:14.311+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:14.508 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:14.500+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:14.555 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:14.548+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:14.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:14.642+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:14.974 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:14.965+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:15.008 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:14.999+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:15.063 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:15.056+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:15.225 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:15.217+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:15.286 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:15.277+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:15.512 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:15.503+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:15.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:15.674+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:15.954 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:15.943+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:16.024 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:16.017+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:16.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:16.066+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:16.256 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:16.249+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:16.265 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:16.256+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:16.545 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:16.536+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:16.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:16.666+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:17.008 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:16.997+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:17.036 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:17.029+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:17.102 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:17.095+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:17.230 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:17.220+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:17.230 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:17.221+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:17.581 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:17.572+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:17.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:17.713+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:18.017 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:18.007+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:18.068 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:18.060+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:18.110 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:18.102+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:18.196 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:18.188+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:18.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:18.264+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:18.541 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:18.532+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:18.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:18.703+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:18.998 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:18.989+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:19.093 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:19.086+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:19.113 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:19.106+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:19.229 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:19.222+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:19.296 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:19.287+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:19.553 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:19.544+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:19.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:19.711+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:19.851 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:19.839+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:19.876 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:44:20.093 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:19.909 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:44:20.125 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:19.954 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:44:20.170 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:19.960 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:44:20.177 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:19.967 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:19.958+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:19.983 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:44:20.199 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:20.000 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:44:20.174 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:20.003 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:44:20.177 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:20.026 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:44:20.243 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:20.073 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:44:20.246 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:26:20.100 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:20.094+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:20.140 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:20.134+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:20.188 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:20.181+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:20.309 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:20.301+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:20.524 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:20.515+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:20.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:20.731+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:21.009 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:21.000+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:21.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:21.069+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:21.165 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:21.159+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:21.200 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:21.190+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:21.329 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:21.322+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:21.549 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:21.540+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:21.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:21.759+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:21.998 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:21.990+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:22.041 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:22.035+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:22.212 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:22.205+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:22.217 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:22.211+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:22.367 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:22.359+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:22.567 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:22.558+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:22.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:22.794+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:22.976 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:22.968+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:23.049 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:23.042+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:23.173 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:23.167+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:23.188 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:23.181+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:23.377 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:23.368+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:23.552 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:23.544+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:23.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:23.812+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:23.941 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:23.929+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:24.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:23.999+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:24.181 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:24.173+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:24.197 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:24.190+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:24.343 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:24.334+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:24.534 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:24.525+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:24.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:24.769+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:24.870 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:24.859+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:24.909 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:24.901+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:25.021 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:25.014+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:25.189 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:25.181+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:25.199 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:25.193+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:25.345 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:25.337+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:25.521 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:25.512+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:25.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:25.747+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:25.932 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:25.924+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:25.994 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:25.986+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:26.170 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:26.162+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:26.215 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:26.208+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:26.306 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:26.298+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:26.553 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:26.545+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:26.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:26.780+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:26.979 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:26.970+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:27.039 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:27.031+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:27.211 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:27.203+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:27.265 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:27.258+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:27.332 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:27.323+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:27.595 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:27.587+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:27.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:27.814+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:28.014 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:28.007+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:28.021 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:28.013+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:28.193 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:28.185+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:28.316 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:28.308+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:28.340 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:28.331+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:28.628 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:28.620+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:28.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:28.796+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:29.009 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:26:28.998+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:47.410841+0000 front 2019-12-11T19:24:47.697121+0000 (oldest deadline 2019-12-11T19:25:32.552973+0000) 2019-12-11T19:26:29.017 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:29.010+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:29.205 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:29.198+0000 1694f700 -1 osd.2 256 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:26:29.277 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:26:29.269+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:48.841018+0000 front 2019-12-11T19:24:50.002709+0000 (oldest deadline 2019-12-11T19:25:33.543918+0000) 2019-12-11T19:26:29.333 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:26:29.324+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.178847+0000 front 2019-12-11T19:24:51.428968+0000 (oldest deadline 2019-12-11T19:25:31.588400+0000) 2019-12-11T19:26:29.658 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:26:29.649+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.429412+0000 front 2019-12-11T19:24:50.180180+0000 (oldest deadline 2019-12-11T19:25:35.197946+0000) 2019-12-11T19:26:29.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:26:29.762+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:50.181340+0000 front 2019-12-11T19:24:51.430889+0000 (oldest deadline 2019-12-11T19:25:31.699810+0000) 2019-12-11T19:26:29.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:26:29.927+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e256 v256) 2019-12-11T19:26:30.065 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:26:30.057+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:24:51.434084+0000 front 2019-12-11T19:24:50.025933+0000 (oldest deadline 2019-12-11T19:25:34.109885+0000) 2019-12-11T19:26:30.247 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:26:30.217+0000 1694f700 -1 osd.2 257 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e255) 2019-12-11T19:28:00.523 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:00.513+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:01.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:01.136+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:01.552 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:01.543+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:02.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:02.127+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:02.565 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:02.557+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:02.577 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:46:02.793 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.592 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:46:02.806 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.601 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:46:02.817 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.606 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:46:02.822 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.608 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:46:02.782 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.637 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:46:02.810 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.740 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:46:02.956 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.756 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:46:02.973 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:02.823 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:46:02.996 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:28:03.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:03.094+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:03.335 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:03.327+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:03.337 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:03.329+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:03.614 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:03.606+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:04.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:04.125+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:04.289 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:04.280+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:04.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:04.295+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:04.618 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:04.608+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:05.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:05.133+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:05.245 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:05.235+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:05.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:05.294+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:05.490 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:05.482+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:05.645 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:05.635+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:06.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:06.130+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:06.240 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:06.230+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:06.283 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:06.276+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:06.494 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:06.487+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:06.632 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:06.623+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:07.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:07.100+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:07.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:07.253+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:07.295 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:07.285+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:07.536 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:07.529+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:07.660 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:07.651+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:08.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:08.130+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:08.273 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:08.265+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:08.300 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:08.290+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:08.501 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:08.493+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:08.629 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:08.620+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:09.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:09.162+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:09.250 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:09.242+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:09.261 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:09.251+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:09.543 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:09.534+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:09.682 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:09.673+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:10.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:10.200+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:10.282 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:10.275+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:10.301 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:10.293+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:10.530 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:10.522+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:10.667 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:10.657+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:11.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:11.177+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:11.318 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:11.307+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:11.326 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:11.318+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:11.538 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:11.530+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:11.638 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:11.628+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:12.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:12.136+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:12.276 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:12.267+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:12.360 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:12.353+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:12.515 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:12.508+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:12.648 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:12.638+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:13.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:13.187+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:13.304 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:13.295+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:13.322 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:13.314+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:13.562 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:13.554+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:13.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:13.652+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:14.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:14.203+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:14.277 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:14.270+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:14.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:14.323+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:14.527 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:14.519+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:14.693 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:14.684+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:15.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:15.172+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:15.221 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:15.211+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:15.244 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:15.235+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:15.345 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:15.335+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:15.503 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:15.495+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:15.668 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:15.659+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:16.183 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:16.172+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:16.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:16.205+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:16.234 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:16.225+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:16.360 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:16.352+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:16.477 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:16.468+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:16.653 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:16.644+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:17.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:17.159+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:17.178 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:17.169+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:17.281 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:17.272+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:17.359 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:17.350+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:17.486 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:17.478+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:17.640 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:17.629+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:18.177 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:18.167+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:18.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:18.171+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:18.328 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:18.321+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:18.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:18.321+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:18.491 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:18.484+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:18.632 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:18.624+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:19.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:19.131+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:19.152 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:19.142+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:19.299 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:19.283+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:19.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:19.295+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:19.526 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:19.518+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:19.591 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:19.582+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:19.957 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:19.948+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:20.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:20.093+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:20.193 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:20.182+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:20.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:20.283+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:20.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:20.296+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:20.487 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:20.480+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:20.594 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:20.582+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:20.995 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:20.987+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:21.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:21.060+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:21.148 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:21.139+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:21.263 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:21.256+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:21.324 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:21.315+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:21.468 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:21.461+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:21.561 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:21.551+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:21.956 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:21.946+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:22.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:22.048+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:22.143 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:22.134+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:22.285 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:22.278+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:22.300 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:22.290+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:22.500 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:22.492+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:22.573 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:22.564+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:22.980 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:22.971+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:23.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:23.094+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:23.107 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:23.096+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:23.278 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:23.270+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:23.297 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:23.288+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:23.475 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:23.467+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:23.616 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:23.607+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:23.969 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:23.960+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:24.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:24.062+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:24.071 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:24.063+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:24.244 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:24.237+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:24.288 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:24.279+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:24.473 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:24.466+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:24.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:24.648+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:24.943 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:24.933+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:25.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:25.094+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:25.116 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:25.104+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:25.223 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:25.216+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:25.278 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:25.270+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:25.447 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:25.440+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:25.626 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:25.617+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:25.900 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:25.891+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:26.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:26.132+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:26.154 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:26.145+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:26.223 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:26.215+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:26.283 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:26.274+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:26.456 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:26.448+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:26.652 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:26.642+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:26.862 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:26.852+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:27.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:27.129+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:27.182 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:27.173+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:27.246 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:27.239+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:27.308 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:27.298+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:27.504 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:27.497+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:27.692 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:27.682+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:27.850 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:27.841+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:28.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:28.168+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:28.176 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:28.167+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:28.212 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:28.206+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:28.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:28.317+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:28.492 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:28.485+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:28.658 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:28.649+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:28.860 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:28.850+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:29.203 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:29.194+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:29.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:29.207+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:29.261 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:29.253+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:29.356 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:29.346+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:29.512 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:29.504+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:29.674 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:29.665+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:29.872 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:29.863+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:30.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:30.174+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:30.243 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:30.235+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:30.253 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:30.244+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:30.407 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:30.398+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:30.484 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:30.477+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:30.660 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:30.651+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:30.836 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:30.827+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:31.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:31.191+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:31.219 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:31.209+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:31.246 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:31.238+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:31.443 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:31.426+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:31.536 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:31.528+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:31.685 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:31.677+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:31.842 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:31.833+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:32.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:32.191+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:32.235 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:32.228+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:32.238 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:32.229+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:32.439 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:32.429+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:32.494 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:32.486+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:32.722 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:32.712+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:32.827 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:32.817+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:33.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:33.175+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:33.193 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:33.184+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:33.229 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:33.222+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:33.467 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:33.456+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:33.519 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:33.511+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:33.760 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:33.750+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:33.840 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:33.830+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:34.190 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:34.179+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:34.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:34.215+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:34.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:34.256+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:34.482 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:34.472+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:34.505 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:34.498+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:34.803 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:34.792+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:34.863 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:34.854+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:35.191 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:35.179+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:35.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:35.211+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:35.265 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:28:35.258+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e262 v262) 2019-12-11T19:28:35.277 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:35.269+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:35.466 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:35.456+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:35.558 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:35.550+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:35.850 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:35.840+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:35.901 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:35.891+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:36.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:36.171+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:36.183 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:36.173+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:36.269 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:36.262+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:36.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:36.506+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:36.606 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:36.597+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:36.859 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:36.847+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:36.923 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:36.912+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:37.204 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:37.194+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:37.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:37.220+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:37.301 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:37.293+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:37.537 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:37.527+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:37.560 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:37.552+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:37.861 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:37.850+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:37.879 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:37.869+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:38.237 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:38.226+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:38.256 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:38.247+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:38.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:38.258+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:38.581 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:38.570+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:38.595 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:38.588+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:38.871 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:38.861+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:38.890 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:38.879+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:39.196 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:39.186+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:39.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:39.291+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:39.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:39.295+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:39.551 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:39.542+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:39.618 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:39.611+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:39.845 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:39.834+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:39.915 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:39.905+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:40.204 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:40.193+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:40.272 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:40.264+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:40.324 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:28:40.316+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e262 v262) 2019-12-11T19:28:40.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:40.336+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:40.581 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:40.571+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:40.666 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:40.658+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:40.889 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:40.879+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:40.924 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:40.914+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:41.237 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:41.226+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:41.278 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:41.269+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:41.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:41.342+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:41.600 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:41.591+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:41.710 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:41.704+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:41.917 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:41.907+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:41.925 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:41.915+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:42.197 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:42.186+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:42.269 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:42.262+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:42.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:42.301+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:42.585 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:42.575+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:42.679 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:42.672+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:42.945 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:42.934+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:42.971 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:42.961+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:43.164 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:43.153+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:43.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:43.256+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:43.279 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:43.271+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:43.544 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:43.533+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:43.645 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:43.638+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:43.898 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:43.889+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:43.976 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:43.965+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:44.159 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:44.149+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:44.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:44.215+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:44.287 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:44.280+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:44.512 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:28:44.502+0000 1694f700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.890811+0000 front 2019-12-11T19:27:18.862030+0000 (oldest deadline 2019-12-11T19:28:02.833481+0000) 2019-12-11T19:28:44.600 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:44.593+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:44.911 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:28:44.901+0000 1694f700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.049457+0000 front 2019-12-11T19:27:18.914188+0000 (oldest deadline 2019-12-11T19:28:19.561217+0000) 2019-12-11T19:28:44.947 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:28:44.937+0000 1694f700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:18.565148+0000 front 2019-12-11T19:27:18.668474+0000 (oldest deadline 2019-12-11T19:28:00.012225+0000) 2019-12-11T19:28:45.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:45.198+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:28:45.207 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:45.197+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:45.266 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:28:45.258+0000 1694f700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:17.308678+0000 front 2019-12-11T19:27:17.309728+0000 (oldest deadline 2019-12-11T19:28:03.076954+0000) 2019-12-11T19:28:45.357 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:28:45.350+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e262 v262) 2019-12-11T19:28:45.592 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:28:45.580+0000 1694f700 -1 osd.0 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.602118+0000 front 2019-12-11T19:27:19.605284+0000 (oldest deadline 2019-12-11T19:28:05.467188+0000) 2019-12-11T19:28:46.169 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:28:46.160+0000 1694f700 -1 osd.5 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:19.313004+0000 front 2019-12-11T19:27:19.321670+0000 (oldest deadline 2019-12-11T19:28:14.245841+0000) 2019-12-11T19:28:46.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:28:46.183+0000 1694f700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:27:16.394722+0000 front 2019-12-11T19:27:16.350759+0000 (oldest deadline 2019-12-11T19:28:00.445521+0000) 2019-12-11T19:29:19.411 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:19.375+0000 11caf700 -1 osd.0 267 build_incremental_map_msg missing incremental map 267 2019-12-11T19:29:42.064 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:42.055+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:42.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:42.291+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:42.680 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:42.671+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:42.813 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:42.805+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:43.040 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:43.031+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:43.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:43.253+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:43.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:43.676+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:43.836 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:43.828+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:44.052 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:44.044+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:44.138 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:44.131+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:44.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:44.245+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:44.451 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:44.443+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:44.703 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:44.695+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:44.841 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:44.833+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:45.098 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:45.089+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:45.100 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:45.092+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:45.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:45.209+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:45.479 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:45.471+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:45.659 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:45.653+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:45.872 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:45.865+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:46.081 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:46.072+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:46.111 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:46.103+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:46.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:46.190+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:46.486 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:46.478+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:46.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:46.627+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:46.895 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:46.889+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:47.091 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:47.082+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:47.145 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:47.136+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:47.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:47.212+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:47.494 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:47.486+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:47.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:47.647+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:47.942 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:47.934+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:48.108 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:48.099+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:48.113 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:48.105+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:48.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:48.210+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:48.535 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:48.526+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:48.640 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:48.633+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:48.956 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:48.949+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:49.115 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:49.106+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:49.118 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:49.110+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:49.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:49.168+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:49.519 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:49.510+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:49.652 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:49.645+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:49.965 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:49.958+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:50.100 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:50.092+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:50.143 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:50.136+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:50.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:50.139+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:50.491 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:50.483+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:50.577 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:50.570+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:50.691 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:50.683+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:51.004 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:29:50.997+0000 1694f700 -1 osd.0 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.695990+0000 front 2019-12-11T19:29:02.093090+0000 (oldest deadline 2019-12-11T19:29:41.887723+0000) 2019-12-11T19:29:51.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:51.110+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:51.127 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:51.118+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:51.188 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:51.180+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:51.516 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:51.508+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:51.533 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:51.526+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:51.686 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:51.679+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:52.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:52.070+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:52.155 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:52.146+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:52.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:52.158+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:52.561 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:52.552+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:52.563 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:52.556+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:52.682 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:52.674+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:53.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:53.105+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:53.175 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:53.166+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:53.213 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:53.205+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:53.566 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:53.558+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:53.571 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:53.563+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:53.705 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:53.698+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:54.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:54.076+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:54.167 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:54.158+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:54.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:54.178+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:54.537 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:54.530+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:54.588 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:54.580+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:54.696 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:54.689+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:55.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:55.067+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:55.142 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:55.134+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:55.144 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:55.136+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:55.532 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:55.525+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:55.578 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:55.570+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:55.671 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:55.664+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:56.109 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:56.099+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:56.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:56.115+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:56.158 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:56.150+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:56.556 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:56.548+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:56.584 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:56.574+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:56.710 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:56.703+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:57.149 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:57.142+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:57.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:57.142+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:57.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:57.160+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:57.541 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:57.531+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:29:57.541 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:57.532+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:57.543 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:57.534+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:57.735 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:57.727+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:58.169 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:58.161+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:58.182 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:58.174+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:58.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:58.180+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:58.558 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:58.550+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:58.577 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:58.570+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:29:58.578 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:58.571+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:58.747 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:58.741+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:29:59.154 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:29:59.146+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:29:59.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:29:59.161+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:29:59.176 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:29:59.167+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:29:59.552 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:29:59.543+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:29:59.587 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:59.579+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:29:59.589 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:29:59.581+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:29:59.794 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:29:59.787+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:00.187 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:00.179+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:00.190 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:00.181+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:00.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:00.189+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:00.563 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:00.554+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:00.620 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:00.612+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:00.626 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:00.619+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:00.795 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:00.788+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:01.147 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:01.139+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:01.161 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:01.152+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:01.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:01.209+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:01.530 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:01.523+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:01.645 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:01.638+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:01.650 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:01.642+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:01.750 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:01.742+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:02.155 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:02.147+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:02.170 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:02.162+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:02.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:02.176+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:02.564 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:02.556+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:02.662 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:02.655+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:02.663 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:02.656+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:02.734 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:02.728+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:03.118 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:03.110+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:03.143 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:03.134+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:03.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:03.166+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:03.616 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:03.608+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:03.658 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:03.652+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:03.663 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:03.656+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:03.693 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:03.685+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:04.093 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:04.085+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:04.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:04.137+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:04.173 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:04.164+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:04.618 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:04.609+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:04.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:04.648+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:04.674 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:04.666+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:04.676 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:04.668+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:05.122 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:05.114+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:05.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:05.170+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:05.223 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:05.215+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:05.586 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:05.577+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:05.673 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:05.666+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:05.707 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:05.700+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:05.708 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:05.701+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:06.140 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:06.132+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:06.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:06.139+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:06.268 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:06.257+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:06.565 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:06.557+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:06.683 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:06.676+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:06.757 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:06.750+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:06.761 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:06.754+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:07.107 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:07.099+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:07.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:07.160+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:07.266 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:07.257+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:07.617 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:07.609+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:07.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:07.647+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:07.803 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:07.795+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:07.804 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:07.797+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:08.092 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:08.084+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:08.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:08.139+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:08.255 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:08.247+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:08.585 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:08.577+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:08.638 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:08.631+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:08.825 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:08.817+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:08.827 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:08.819+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:09.051 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:09.043+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:09.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:09.095+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:09.284 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:09.275+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:09.605 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:09.597+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:09.687 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:09.680+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:09.797 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:09.788+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:09.798 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:09.791+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:10.036 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:10.027+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:10.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:10.077+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:10.310 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:10.301+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:10.654 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:10.639+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:10.659 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:10.652+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:10.777 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:10.770+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:10.778 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:10.771+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:11.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:11.061+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:11.084 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:11.074+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:11.366 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:11.356+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:11.618 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:11.609+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:11.713 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:11.705+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:11.791 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:11.782+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:11.793 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:11.785+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:12.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:12.073+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:12.085 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:12.076+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:12.378 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:12.368+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:12.594 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:12.586+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:12.671 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:12.664+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:12.755 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:12.745+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:12.756 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:12.748+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:13.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:13.043+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:13.053 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:13.044+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:13.355 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:13.346+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:13.557 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:13.547+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:13.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:13.677+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:13.738 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:13.729+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:13.738 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:13.731+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:14.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:14.007+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:14.091 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:14.083+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:14.348 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:14.339+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:14.585 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:14.576+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:14.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:14.647+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:14.725 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:14.718+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:14.730 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:14.723+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:14.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:14.974+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:15.049 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:15.039+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:15.320 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:15.311+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:15.575 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:15.565+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:15.624 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:30:15.615+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 41sec e269 v269) 2019-12-11T19:30:15.689 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:15.682+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:15.727 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:15.721+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:15.731 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:15.723+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:16.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:15.994+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:16.026 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:16.017+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:16.306 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:16.297+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:16.557 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:16.548+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:16.677 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:16.670+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:16.764 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:16.757+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:16.768 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:16.760+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:16.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:16.981+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:17.009 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:17.001+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:17.270 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:17.261+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:17.525 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:17.516+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:17.648 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:17.641+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:17.802 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:17.793+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:17.803 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:17.795+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:17.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:17.952+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:18.033 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:18.023+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:18.267 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:18.259+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:18.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:18.501+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:18.653 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:18.645+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:18.795 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:18.789+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:18.799 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:18.792+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:18.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:18.946+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:19.003 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:18.993+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:19.253 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:19.243+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:19.497 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:19.488+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:19.651 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:19.644+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:19.805 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:19.798+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:19.809 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:19.802+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:19.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:19.951+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:20.021 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:20.012+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:20.313 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:20.300+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:20.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:20.534+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:20.634 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:30:20.626+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 41sec e269 v269) 2019-12-11T19:30:20.655 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:20.647+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:20.792 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:20.782+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:20.793 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:20.786+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:20.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:20.989+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:21.039 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:21.030+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:21.286 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:21.277+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:21.515 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:21.506+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:21.615 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:21.608+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:21.800 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:21.794+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:21.803 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:21.797+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:22.004 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:21.994+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:22.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:22.018+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:22.301 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:22.291+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:22.535 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:22.526+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:22.587 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:22.580+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:22.836 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:22.827+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:22.838 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:22.830+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:22.995 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:22.986+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:23.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:22.998+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:23.305 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:23.297+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:23.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:23.501+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:23.623 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:23.616+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:23.828 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:23.821+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:23.835 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:23.826+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:24.043 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:24.035+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:24.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:24.039+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:24.267 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:24.258+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:24.503 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:24.493+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:24.623 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:24.616+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:24.797 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:24.788+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:24.798 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:24.791+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:25.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:25.004+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:25.054 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:25.046+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:25.276 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:25.268+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:25.486 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:25.478+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:25.609 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:25.601+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:25.649 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:30:25.642+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 41sec e269 v269) 2019-12-11T19:30:25.762 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:25.755+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:25.764 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:25.757+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:26.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:26.004+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:26.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:26.014+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:26.271 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:26.263+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:26.535 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:26.527+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:26.655 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:26.648+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:26.781 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:26.772+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:26.783 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:26.774+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:26.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:26.985+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:27.028 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:27.019+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:27.252 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:27.244+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:27.566 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:27.557+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:27.693 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:27.684+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:27.757 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:27.747+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:27.759 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:27.748+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:27.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:27.990+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:28.032 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:28.022+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:28.246 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:28.238+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:28.522 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:28.514+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:28.745 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:28.736+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:28.791 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:28.780+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:28.792 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:28.783+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:29.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:29.017+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:29.038 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:29.030+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:29.216 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:29.208+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:29.535 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:29.527+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:29.744 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:29.735+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:29.808 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:29.799+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:29.809 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:29.801+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:29.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:30:29.973+0000 1694f700 -1 osd.1 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:28:58.789811+0000 front 2019-12-11T19:28:59.125963+0000 (oldest deadline 2019-12-11T19:29:42.247379+0000) 2019-12-11T19:30:30.040 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:30.033+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:30:30.211 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:30:30.202+0000 1694f700 -1 osd.4 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:02.223077+0000 front 2019-12-11T19:29:01.852409+0000 (oldest deadline 2019-12-11T19:29:41.468881+0000) 2019-12-11T19:30:30.499 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:30:30.491+0000 1694f700 -1 osd.6 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.903243+0000 front 2019-12-11T19:29:01.700716+0000 (oldest deadline 2019-12-11T19:29:44.227451+0000) 2019-12-11T19:30:30.706 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:30:30.698+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 41sec e269 v269) 2019-12-11T19:30:30.734 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:30:30.728+0000 1694f700 -1 osd.3 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:01.053262+0000 front 2019-12-11T19:29:01.686842+0000 (oldest deadline 2019-12-11T19:29:42.477075+0000) 2019-12-11T19:30:30.768 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:30.759+0000 1694f700 -1 osd.2 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:29:16.680900+0000 (oldest deadline 2019-12-11T19:29:56.680900+0000) 2019-12-11T19:30:30.768 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:30:30.761+0000 1694f700 -1 osd.2 269 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-12-11T19:30:31.038 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:30:31.031+0000 1694f700 -1 osd.5 269 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:29:00.956893+0000 front 2019-12-11T19:29:01.850522+0000 (oldest deadline 2019-12-11T19:29:44.042211+0000) 2019-12-11T19:31:37.614 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:31:37.606+0000 1694f700 -1 osd.7 275 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4349.0:109199 5.4 5:2b04a3e9:::notify.6:head [watch reconnect cookie 1471045888 gen 45] snapc 0=[] ondisk+write+known_if_redirected e273) 2019-12-11T19:31:56.177 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:49:56.394 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.184 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:49:56.401 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.200 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:49:56.417 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.205 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:49:56.379 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.210 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:49:56.427 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.212 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:49:56.386 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.441 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:49:56.657 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.490 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:49:56.706 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:31:56.535 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:49:56.708 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:32:07.310 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:07.300+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:07.334 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:07.326+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:07.496 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:07.487+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:08.153 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:08.142+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:08.305 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:08.295+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:08.354 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:08.347+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:08.510 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:08.499+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:08.642 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:08.632+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:08.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:08.729+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:09.127 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:09.117+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:09.277 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:09.267+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:09.384 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:09.376+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:09.530 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:09.521+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:09.662 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:09.652+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:09.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:09.726+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:10.164 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:10.155+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:10.318 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:10.310+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:10.342 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:10.334+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:10.540 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:10.531+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:10.681 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:10.672+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:10.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:10.763+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:11.211 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:11.201+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:11.333 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:11.325+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:11.364 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:11.355+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:11.531 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:11.522+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:11.682 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:11.671+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:11.733 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:11.725+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:11.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:11.778+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:12.258 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:12.248+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:12.377 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:12.367+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:12.383 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:12.374+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:12.518 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:12.509+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:12.645 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:12.635+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:12.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:12.756+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:12.779 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:12.771+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:13.215 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:13.205+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:13.381 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:13.373+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:13.421 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:13.412+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:13.561 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:13.546+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:13.661 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:13.651+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:13.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:13.761+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:13.829 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:13.821+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:14.210 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:14.194+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:14.417 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:14.408+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:14.418 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:14.408+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:14.530 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:14.521+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:14.714 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:14.705+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:14.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:14.734+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:14.802 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:14.795+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:15.193 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:15.183+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:15.405 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:15.396+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:15.442 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:15.433+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:15.541 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:15.532+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:15.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:15.702+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:15.736 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:15.727+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:15.824 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:15.817+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:16.174 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:16.166+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:16.430 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:16.423+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:16.488 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:16.478+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:16.512 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:16.502+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:16.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:16.669+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:16.782 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:16.773+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:16.840 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:16.833+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:17.178 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:17.169+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:17.392 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:17.384+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:17.470 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:17.461+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:17.563 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:17.553+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:17.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:17.663+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:17.813 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:17.806+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:17.816 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:17.807+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:18.201 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:18.192+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:18.369 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:18.358+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:18.491 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:18.481+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:18.566 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:18.556+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:18.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:18.648+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:18.841 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:18.832+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:18.861 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:18.853+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:19.246 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:19.235+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:19.354 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:19.347+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:19.449 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:19.439+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:19.528 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:19.518+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:19.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:19.626+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:19.817 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:19.808+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:19.862 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:19.854+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:20.231 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:20.222+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:20.391 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:20.382+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:20.475 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:20.466+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:20.577 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:20.567+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:20.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:20.618+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:20.802 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:20.793+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:20.846 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:20.837+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:21.276 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:21.266+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:21.397 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:21.389+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:21.479 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:21.470+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:21.577 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:21.568+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:21.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:21.581+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:21.831 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:21.822+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:21.833 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:21.825+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:22.295 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:22.285+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:22.376 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:22.369+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:22.441 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:22.432+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:22.553 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:22.544+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:22.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:22.569+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:22.827 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:22.819+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:22.871 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:22.862+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:23.253 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:23.243+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:23.411 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:23.403+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:23.419 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:23.411+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:23.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:23.576+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:23.602 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:23.592+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:23.847 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:23.839+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:23.902 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:23.893+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:24.270 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:24.261+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:24.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:24.394+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:24.407 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:24.400+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:24.564 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:24.556+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:24.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:24.580+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:24.870 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:24.861+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:24.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:24.873+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:25.279 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:25.267+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:25.383 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:25.375+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:25.439 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:25.429+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:25.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:25.576+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:25.618 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:25.609+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:25.856 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:25.849+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:25.857 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:25.847+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:26.317 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:26.308+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:26.423 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:26.415+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:26.472 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:26.462+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:26.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:26.555+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:26.623 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:26.614+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:26.842 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:26.834+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:26.854 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:26.845+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:27.372 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:27.362+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:27.386 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:27.377+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:27.507 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:27.498+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:27.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:27.555+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:27.619 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:27.608+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:27.838 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:27.828+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:27.890 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:27.882+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:28.334 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:28.325+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:28.426 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:28.418+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:28.516 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:28.504+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:28.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:28.576+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:28.640 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:28.631+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:28.800 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:28.791+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:28.874 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:28.867+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:29.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:29.371+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:29.404 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:29.396+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:29.555 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:29.546+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:29.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:29.583+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:29.635 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:29.626+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:29.843 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:29.833+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:29.912 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:29.904+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:30.422 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:30.413+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:30.439 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:30.432+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:30.532 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:30.523+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:30.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:30.555+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:30.666 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:30.658+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:30.876 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:30.867+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:30.935 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:30.926+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:31.418 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:31.410+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:31.467 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:31.458+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:31.540 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:31.530+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:31.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:31.550+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:31.673 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:31.664+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:31.860 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:31.851+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:31.950 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:31.943+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:32.449 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:32.442+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:32.451 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:32.443+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:32.542 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:32.533+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:32.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:32.595+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:32.666 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:32.657+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:32.834 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:32.824+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:32.988 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:32.980+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:33.446 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:33.437+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:33.452 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:33.444+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:33.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:33.509+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:33.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:33.614+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:33.723 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:33.714+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:33.857 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:33.848+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:33.983 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:33.975+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:34.481 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:34.474+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:34.489 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:34.479+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:34.533 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:34.523+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:34.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:34.597+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:34.725 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:34.715+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:34.853 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:34.843+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:35.017 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:35.010+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:35.489 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:35.481+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:35.508 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:35.497+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:35.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:35.532+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:35.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:35.560+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:35.709 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:35.699+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:35.815 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:35.805+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:35.987 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:35.979+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:36.473 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:36.465+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:36.479 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:36.469+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:36.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:36.550+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:36.564 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:36.555+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:36.707 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:36.697+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:36.778 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:36.768+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:36.976 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:36.967+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:37.455 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:37.445+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:37.493 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:37.484+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:37.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:37.558+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:37.612 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:37.601+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:37.699 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:37.688+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:37.775 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:37.764+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:37.935 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:37.927+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:38.452 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:38.442+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:38.480 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:38.472+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:38.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:38.539+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:38.572 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:38.563+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:38.717 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:38.706+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:38.754 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:38.744+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:38.969 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:38.960+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:39.452 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:39.442+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:39.506 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:39.499+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:39.563 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:39.553+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:39.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:39.590+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:39.717 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:39.706+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:39.795 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:39.785+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:39.944 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:39.936+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:40.420 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:40.409+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:40.529 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:40.519+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:40.551 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:40.544+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:40.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:40.599+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:40.682 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:40.673+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:40.849 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:40.838+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:40.987 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:40.979+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:41.090 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:32:41.083+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e275 v275) 2019-12-11T19:32:41.465 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:41.455+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:41.494 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:41.483+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:41.515 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:41.506+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:41.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:41.590+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:41.692 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:41.681+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:41.862 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:41.852+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:41.949 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:41.942+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:42.477 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:42.467+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:42.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:42.484+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:42.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:42.500+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:42.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:42.612+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:42.693 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:42.681+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:42.820 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:42.810+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:42.912 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:42.905+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:43.487 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:43.477+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:43.512 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:43.503+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:43.532 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:43.524+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:43.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:43.569+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:43.747 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:43.737+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:43.827 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:43.817+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:43.953 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:43.947+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:44.470 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:44.460+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:44.492 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:44.482+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:44.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:44.550+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:44.561 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:44.552+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:44.757 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:44.745+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:44.846 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:44.836+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:44.929 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:44.921+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:45.446 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:45.436+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:45.509 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:32:45.496+0000 1694f700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.988760+0000 front 2019-12-11T19:31:24.464315+0000 (oldest deadline 2019-12-11T19:32:06.691808+0000) 2019-12-11T19:32:45.582 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:32:45.576+0000 1694f700 -1 osd.3 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:21.664032+0000 front 2019-12-11T19:31:21.019856+0000 (oldest deadline 2019-12-11T19:32:06.910245+0000) 2019-12-11T19:32:45.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:32:45.598+0000 1694f700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:23.291756+0000 front 2019-12-11T19:31:23.325555+0000 (oldest deadline 2019-12-11T19:32:07.954453+0000) 2019-12-11T19:32:45.730 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:32:45.720+0000 1694f700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.707974+0000 front 2019-12-11T19:31:25.733409+0000 (oldest deadline 2019-12-11T19:32:06.752152+0000) 2019-12-11T19:32:45.898 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:45.888+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:32:45.936 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:45.929+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:46.144 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:32:46.138+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 46sec e275 v275) 2019-12-11T19:32:46.481 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:32:46.469+0000 1694f700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:22.156760+0000 front 2019-12-11T19:31:22.132705+0000 (oldest deadline 2019-12-11T19:32:07.327014+0000) 2019-12-11T19:32:46.908 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:32:46.899+0000 1694f700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:26.283717+0000 front 2019-12-11T19:31:26.270196+0000 (oldest deadline 2019-12-11T19:32:11.542534+0000) 2019-12-11T19:32:46.911 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:32:46.902+0000 1694f700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:31:25.582469+0000 front 2019-12-11T19:31:25.541238+0000 (oldest deadline 2019-12-11T19:32:08.419576+0000) 2019-12-11T19:33:44.226 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:44.217+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:44.423 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:44.417+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:44.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:44.980+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:45.234 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:45.226+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:45.456 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:45.449+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:45.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:45.952+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:46.228 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:46.221+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:46.266 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:46.254+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:46.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:46.485+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:46.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:46.948+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:47.033 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:47.025+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:47.204 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:47.197+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:47.315 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:47.307+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:47.358 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:47.350+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:47.472 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:47.465+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:47.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:47.938+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:48.084 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:48.075+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:48.239 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:48.232+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:48.313 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:48.304+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:48.323 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:48.315+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:48.475 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:48.467+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:48.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:48.962+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:49.123 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:49.115+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:49.268 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:49.260+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:49.274 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:49.267+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:49.338 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:49.329+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:49.492 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:49.486+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:49.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:49.985+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:50.086 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:50.077+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:50.307 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:50.298+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:50.319 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:50.312+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:50.351 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:50.342+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:50.463 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:50.456+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:50.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:50.961+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:51.089 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:51.080+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:51.283 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:51.276+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:51.300 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:51.291+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:51.389 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:51.381+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:51.459 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:51.452+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:52.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:52.009+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:52.090 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:52.082+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:52.246 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:52.239+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:52.254 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:52.246+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:52.432 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:52.425+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:52.439 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:52.432+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:52.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:52.973+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:53.141 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:53.133+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:53.262 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:53.252+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:53.303 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:53.295+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:53.432 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:53.424+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:53.458 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:53.447+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:54.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:54.005+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:54.149 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:54.141+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:54.271 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:54.264+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:54.318 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:54.310+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:54.421 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:54.414+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:54.449 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:54.441+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:54.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:54.974+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:55.169 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:55.161+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:55.252 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:55.244+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:55.325 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:55.317+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:55.388 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:55.381+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:55.425 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:55.416+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:55.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:55.991+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:56.195 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:56.187+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:56.207 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:56.200+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:56.369 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:56.361+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:56.393 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:56.386+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:56.434 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:56.427+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:57.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:57.017+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:57.168 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:57.160+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:57.179 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:57.171+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:57.413 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:57.405+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:57.425 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:57.417+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:57.437 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:57.430+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:57.519 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:33:57.509+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:33:58.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:58.036+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:58.162 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:58.154+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:58.215 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:58.206+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:58.431 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:58.422+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:58.457 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:58.444+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:58.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:58.484+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:58.528 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:33:58.518+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:33:59.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:33:59.087+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:33:59.154 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:33:59.147+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:33:59.199 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:33:59.189+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:33:59.465 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:33:59.457+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:33:59.474 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:33:59.467+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:33:59.489 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:33:59.483+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:33:59.503 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:33:59.496+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:00.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:00.137+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:00.167 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:00.159+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:00.178 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:00.172+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:00.488 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:00.480+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:00.495 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:00.487+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:00.503 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:00.496+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:00.514 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:00.505+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:01.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:01.178+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:01.188 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:01.180+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:01.207 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:01.200+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:01.462 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:01.455+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:01.487 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:01.480+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:01.536 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:01.527+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:01.544 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:01.536+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:02.177 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:02.158+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:02.186 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:02.180+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:02.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:02.184+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:02.494 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:02.486+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:02.500 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:02.492+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:02.576 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:02.568+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:02.589 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:02.582+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:03.215 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:03.207+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:03.220 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:03.211+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:03.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:03.213+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:03.477 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:03.469+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:03.498 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:03.490+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:03.541 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:03.533+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:03.574 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:03.566+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:04.190 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:04.181+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:04.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:04.193+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:04.212 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:04.203+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:04.444 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:04.434+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:04.446 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:04.436+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:04.520 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:04.512+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:04.562 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:04.554+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:04.568 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:04.560+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:05.147 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:05.139+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:05.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:05.220+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:05.259 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:05.251+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:05.408 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:05.397+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:05.413 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:05.400+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:05.540 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:05.531+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:05.566 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:05.557+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:05.595 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:05.586+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:06.165 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:06.157+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:06.239 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:06.232+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:06.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:06.235+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:06.433 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:06.425+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:06.434 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:06.427+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:06.542 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:06.534+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:06.572 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:06.566+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:06.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:06.599+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:07.152 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:07.145+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:07.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:07.241+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:07.293 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:07.284+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:07.440 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:07.431+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:07.441 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:07.433+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:07.544 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:07.536+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:07.603 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:07.596+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:07.658 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:07.650+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:08.141 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:08.134+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:08.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:08.228+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:08.309 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:08.301+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:08.417 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:08.408+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:08.419 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:08.410+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:08.577 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:08.569+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:08.603 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:08.596+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:08.663 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:08.654+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:09.196 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:09.189+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:09.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:09.222+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:09.298 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:09.289+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:09.405 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:09.397+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:09.408 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:09.399+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:09.601 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:09.590+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:09.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:09.647+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:09.704 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:09.696+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:10.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:10.180+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:10.202 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:10.195+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:10.288 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:10.280+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:10.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:10.395+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:10.405 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:10.397+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:10.649 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:10.641+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:10.659 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:10.652+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:10.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:10.669+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:11.156 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:11.150+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:11.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:11.207+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:11.275 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:11.267+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:11.398 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:11.391+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:11.401 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:11.394+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:11.514 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:52:11.730 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.517 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:52:11.734 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.594 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:52:11.767 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.595 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:52:11.769 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.616 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:52:11.833 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.620 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:52:11.836 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.657 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:11.649+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:11.658 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:11.651+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:11.716 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:52:11.932 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.729 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:52:11.902 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:11.729 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:11.720+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:11.756 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:52:11.973 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:34:12.149 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:12.142+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:12.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:12.228+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:12.298 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:12.289+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:12.370 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:12.363+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:12.373 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:12.366+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:12.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:12.663+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:12.685 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:12.675+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:12.711 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:12.696+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:13.174 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:13.167+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:13.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:13.280+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:13.337 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:13.328+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:13.418 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:13.409+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:13.419 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:13.411+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:13.646 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:13.637+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:13.662 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:13.648+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:13.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:13.669+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:14.154 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:14.147+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:14.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:14.272+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:14.372 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:14.362+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:14.455 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:14.446+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:14.457 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:14.448+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:14.606 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:14.599+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:14.660 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:14.650+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:14.700 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:14.690+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:15.127 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:15.119+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:15.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:15.317+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:15.347 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:15.338+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:15.503 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:15.496+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:15.504 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:15.497+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:15.657 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:15.647+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:15.661 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:15.653+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:15.721 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:15.713+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:16.115 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:16.108+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:16.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:16.349+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:16.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:16.362+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:16.469 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:16.461+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:16.469 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:16.463+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:16.511 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:16.503+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:16.611 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:16.604+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:16.673 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:16.664+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:16.742 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:16.733+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:17.124 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:17.118+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:17.386 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:17.377+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:17.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:17.401+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:17.501 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:17.493+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:17.502 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:17.495+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:17.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:17.627+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:17.637 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:17.628+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:17.716 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:17.706+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:18.110 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:18.102+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:18.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:18.357+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:18.405 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:18.396+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:18.459 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:18.452+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:18.460 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:18.453+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:18.606 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:18.596+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:18.675 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:18.668+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:18.737 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:18.728+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:19.069 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:19.062+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:19.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:19.358+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:19.395 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:19.381+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:19.492 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:19.483+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:19.492 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:19.486+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:19.624 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:19.615+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:19.647 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:19.639+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:19.752 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:19.743+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:20.032 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:20.025+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:20.367 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:20.358+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:20.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:20.407+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:20.508 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:20.501+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:20.513 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:20.506+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:20.601 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:20.594+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:20.602 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:20.592+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:20.722 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:20.713+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:21.019 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:21.012+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:21.333 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:21.324+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:21.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:21.388+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:21.474 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:21.465+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:21.475 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:21.467+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:21.526 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:21.520+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:21.620 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:21.612+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:21.628 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:21.622+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:21.766 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:21.756+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:22.026 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:22.018+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:22.312 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:22.301+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:22.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:22.383+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:22.441 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:22.432+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:22.443 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:22.435+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:22.628 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:22.621+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:22.629 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:22.620+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:22.800 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:22.790+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:23.011 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:23.004+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:23.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:23.318+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:23.429 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:23.422+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:23.434 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:23.426+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:23.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:23.436+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:23.627 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:23.620+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:23.678 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:23.669+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:23.808 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:23.797+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:24.012 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:24.005+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:24.361 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:24.352+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:24.424 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:24.415+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:24.425 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:24.417+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:24.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:24.424+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:24.658 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:24.648+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:24.670 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:24.662+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:24.833 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:24.824+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:25.061 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:25.053+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:25.381 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:25.373+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:25.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:25.398+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:25.408 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:25.401+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:25.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:25.420+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:25.650 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:25.642+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:25.668 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:25.660+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:25.836 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:25.828+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:26.044 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:26.036+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:26.367 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:26.359+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:26.455 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:26.447+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:26.456 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:26.449+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:26.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:26.472+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:26.547 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:26.537+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:26.611 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:26.604+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:26.673 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:26.665+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:26.792 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:26.782+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:27.043 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:27.037+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:27.335 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:27.326+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:27.465 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:27.459+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:27.470 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:27.462+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:27.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:27.495+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:27.629 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:27.622+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:27.722 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:27.713+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:27.794 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:27.786+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:28.000 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:27.993+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:28.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:28.363+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:28.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:28.485+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:28.518 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:28.510+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:28.519 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:28.511+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:28.609 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:28.602+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:28.721 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:28.713+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:28.759 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:28.750+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:29.043 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:29.036+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:29.404 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:29.396+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:29.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:29.498+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:29.551 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:29.543+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:29.553 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:29.544+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:29.577 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:29.570+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:29.700 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:29.691+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:29.739 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:29.731+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:30.004 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:29.997+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:30.418 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:30.409+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:30.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:30.463+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:30.583 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:30.576+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:30.586 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:30.579+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:30.589 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:30.582+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:30.713 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:30.706+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:30.752 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:30.742+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:30.982 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:30.975+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:31.376 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:31.368+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:31.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:31.451+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:31.568 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:31.557+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:31.601 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:31.594+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:31.604 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:31.596+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:31.605 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:31.598+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:31.686 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:31.678+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:31.798 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:31.789+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:31.976 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:31.969+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:32.373 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:32.365+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:32.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:32.424+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:32.623 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:32.615+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:32.642 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:32.635+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:32.644 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:32.636+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:32.737 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:32.728+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:32.787 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:32.779+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:32.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:32.972+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:33.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:33.379+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:33.424 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:33.416+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:33.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:33.624+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:33.678 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:33.671+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:33.682 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:33.675+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:33.714 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:33.705+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:33.814 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:33.805+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:34.024 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:34.016+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:34.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:34.402+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:34.435 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:34.427+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:34.671 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:34.664+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:34.673 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:34.665+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:34.673 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:34.665+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:34.733 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:34.725+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:34.798 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:34.789+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:34.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:34.971+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:35.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:35.442+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:35.456 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:35.447+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:35.688 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:35.682+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:35.692 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:35.685+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:35.700 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:35.693+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:35.747 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:35.739+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:35.785 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:35.776+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:36.024 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:36.017+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:36.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:36.480+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:36.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:36.501+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:36.586 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:36.576+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:36.697 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:36.690+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:36.698 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:36.691+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:36.715 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:36.708+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:36.749 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:36.740+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:36.758 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:36.750+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:37.010 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:37.003+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:37.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:37.442+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:37.499 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:37.490+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:37.708 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:37.700+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:37.712 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:37.704+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:37.722 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:37.714+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:37.723 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:37.714+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:37.725 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:37.716+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:38.059 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:38.052+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:38.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:38.464+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:38.515 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:38.507+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:38.692 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:38.682+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:38.737 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:38.729+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:38.738 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:38.730+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:38.747 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:38.740+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:38.761 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:38.753+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:39.026 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:39.020+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:39.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:39.515+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:39.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:39.535+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:39.651 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:39.644+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:39.714 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:39.707+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:39.719 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:39.712+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:39.768 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:39.760+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:39.791 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:39.784+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:40.021 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:40.014+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:40.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:40.485+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:40.553 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:40.544+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:40.699 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:40.692+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:40.700 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:40.693+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:40.704 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:34:40.695+0000 1694f700 -1 osd.5 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.910265+0000 front 2019-12-11T19:33:02.264494+0000 (oldest deadline 2019-12-11T19:33:46.961384+0000) 2019-12-11T19:34:40.749 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:34:40.742+0000 1694f700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.194865+0000 front 2019-12-11T19:33:01.211133+0000 (oldest deadline 2019-12-11T19:33:44.355114+0000) 2019-12-11T19:34:40.789 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:34:40.782+0000 1694f700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.627847+0000 front 2019-12-11T19:33:01.626952+0000 (oldest deadline 2019-12-11T19:33:45.719500+0000) 2019-12-11T19:34:41.032 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:41.025+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:34:41.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:34:41.491+0000 1694f700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:02.263014+0000 front 2019-12-11T19:33:02.242242+0000 (oldest deadline 2019-12-11T19:33:44.458069+0000) 2019-12-11T19:34:41.573 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:34:41.565+0000 1694f700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:33:01.493004+0000 front 2019-12-11T19:33:02.031220+0000 (oldest deadline 2019-12-11T19:33:46.539989+0000) 2019-12-11T19:34:41.648 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:34:41.638+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e281 v281) 2019-12-11T19:34:41.665 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:41.657+0000 1694f700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:33:23.741371+0000 (oldest deadline 2019-12-11T19:34:03.741371+0000) 2019-12-11T19:34:41.665 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:34:41.659+0000 1694f700 -1 osd.2 281 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e279) 2019-12-11T19:34:42.080 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:34:42.074+0000 1694f700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:32:59.670712+0000 front 2019-12-11T19:33:00.547215+0000 (oldest deadline 2019-12-11T19:33:43.837594+0000) 2019-12-11T19:35:03.883 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:35:03.834+0000 21852700 -1 reset not still connected to 0x100d28e0 2019-12-11T19:35:03.963 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:35:03.906+0000 3578e700 -1 osd.7 281 build_incremental_map_msg missing incremental map 279 2019-12-11T19:35:46.093 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:53:46.309 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.102 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:53:46.318 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.111 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:53:46.327 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.114 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:53:46.331 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.123 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:53:46.297 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.140 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:53:46.314 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.252 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:53:46.468 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.265 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:53:46.482 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:35:46.380 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:53:46.554 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:36:09.092 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:09.082+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:10.091 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:10.084+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:10.131 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:10.122+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:10.948 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:10.942+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:11.115 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:11.108+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:11.147 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:11.137+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:11.625 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:11.615+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:11.802 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:11.792+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:11.986 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:11.978+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:12.074 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:12.067+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:12.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:12.157+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:12.632 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:12.622+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:12.760 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:12.751+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:12.949 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:12.941+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:13.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:13.033+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:13.058 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:13.051+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:13.067 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:13.056+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:13.190 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:13.181+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:13.606 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:13.597+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:13.729 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:13.716+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:13.914 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:13.905+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:14.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:14.026+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:14.056 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:14.048+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:14.110 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:14.100+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:14.227 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:14.217+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:14.599 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:14.590+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:14.755 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:14.746+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:14.874 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:14.864+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:15.056 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:15.045+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:15.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:15.049+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:15.086 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:15.076+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:15.257 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:15.248+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:15.635 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:15.627+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:15.709 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:15.700+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:15.834 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:15.826+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:16.081 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:16.073+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:16.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:16.084+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:16.121 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:16.113+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:16.224 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:16.215+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:16.609 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:16.599+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:16.711 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:16.702+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:16.851 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:16.842+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:17.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:17.046+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:17.126 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:17.118+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:17.141 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:17.132+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:17.257 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:17.247+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:17.570 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:17.562+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:17.763 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:17.753+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:17.894 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:17.887+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:18.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:18.030+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:18.130 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:18.122+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:18.194 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:18.184+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:18.220 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:18.211+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:18.556 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:18.546+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:18.768 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:18.758+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:18.906 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:18.899+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:19.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:19.040+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:19.087 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:19.080+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:19.213 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:19.204+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:19.269 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:19.259+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:19.520 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:19.512+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:19.756 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:19.746+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:19.941 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:19.933+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:20.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:20.015+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:20.076 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:20.069+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:20.250 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:20.241+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:20.311 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:20.301+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:20.522 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:20.513+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:20.788 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:20.776+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:20.928 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:20.921+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:21.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:21.049+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:21.060 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:21.051+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:21.220 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:21.211+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:21.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:21.325+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:21.569 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:21.560+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:21.790 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:21.781+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:21.907 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:21.900+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:22.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:22.045+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:22.066 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:22.057+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:22.182 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:22.173+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:22.319 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:22.309+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:22.607 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:22.598+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:22.819 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:22.809+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:22.912 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:22.906+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:23.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:23.064+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:23.090 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:23.083+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:23.205 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:23.196+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:23.326 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:23.317+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:23.590 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:23.580+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:23.809 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:23.799+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:23.877 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:23.869+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:24.088 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:24.081+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:24.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:24.109+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:24.201 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:24.191+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:24.336 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:24.327+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:24.632 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:24.620+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:24.805 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:24.796+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:24.855 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:24.848+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:25.042 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:25.036+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:25.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:25.130+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:25.254 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:25.244+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:25.382 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:25.373+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:25.662 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:25.653+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:25.803 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:25.793+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:25.841 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:25.834+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:25.998 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:25.991+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:26.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:26.175+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:26.253 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:26.243+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:26.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:26.377+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:26.700 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:26.691+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:26.825 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:26.816+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:26.871 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:26.863+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:27.016 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:27.009+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:27.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:27.133+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:27.244 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:27.235+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:27.401 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:27.392+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:27.716 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:27.706+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:27.812 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:27.802+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:27.884 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:27.875+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:27.992 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:27.984+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:28.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:28.181+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:28.230 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:28.220+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:28.369 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:28.360+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:28.752 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:28.743+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:28.866 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:28.856+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:28.934 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:28.927+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:29.017 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:29.009+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:29.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:29.182+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:29.238 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:29.228+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:29.381 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:29.371+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:29.731 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:29.721+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:29.919 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:29.910+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:29.953 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:29.946+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:30.051 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:30.044+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:30.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:30.183+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:30.238 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:30.229+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:30.382 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:30.372+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:30.778 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:30.769+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:30.898 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:30.888+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:30.960 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:30.952+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:31.052 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:31.044+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:31.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:31.233+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:31.282 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:31.273+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:31.385 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:31.375+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:31.763 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:31.753+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:31.856 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:31.848+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:31.932 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:31.925+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:32.104 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:32.097+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:32.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:32.197+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:32.247 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:32.238+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:32.404 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:32.395+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:32.736 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:32.727+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:32.878 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:32.868+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:32.975 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:32.967+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:33.146 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:33.138+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:33.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:33.198+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:33.286 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:33.276+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:33.393 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:33.382+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:33.744 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:33.734+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:33.886 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:33.877+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:33.957 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:33.949+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:34.150 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:34.142+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:34.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:34.231+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:34.324 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:34.314+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:34.450 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:34.441+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:34.780 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:34.770+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:34.927 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:34.916+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:35.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:34.998+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:35.162 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:35.155+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:35.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:35.253+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:35.295 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:35.285+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:35.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:35.404+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:35.760 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:35.751+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:35.911 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:35.901+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:35.965 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:35.956+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:36.151 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:36.143+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:36.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:36.266+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:36.347 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:36.338+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:36.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:36.376+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:36.797 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:36.786+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:36.921 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:36.913+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:36.958 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:36.947+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:37.153 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:37.146+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:37.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:37.263+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:37.318 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:37.307+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:37.398 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:37.388+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:37.816 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:37.805+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:37.947 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:37.939+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:38.009 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:37.998+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:38.116 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:38.107+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:38.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:38.247+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:38.339 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:38.329+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:38.406 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:38.395+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:38.816 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:38.806+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:38.926 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:38.919+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:39.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:39.021+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:39.098 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:39.090+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:39.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:39.249+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:39.393 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:39.381+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:39.428 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:39.418+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:39.788 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:39.776+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:39.935 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:39.927+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:40.080 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:40.068+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:40.094 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:40.087+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:40.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:40.240+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:40.404 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:40.394+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:40.424 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:40.413+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:40.831 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:40.821+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:40.891 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:40.884+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:41.081 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:41.074+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:41.096 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:41.086+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:41.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:41.263+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:41.445 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:41.434+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:41.467 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:41.455+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:41.807 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:41.797+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:41.850 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:41.841+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:42.078 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:42.067+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:42.081 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:36:42.075+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e287 v287) 2019-12-11T19:36:42.115 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:42.108+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:42.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:42.291+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:42.493 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:42.483+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:42.519 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:42.508+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:42.795 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:42.784+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:42.881 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:42.874+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:43.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:43.092+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:43.103 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:43.094+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:43.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:43.258+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:43.518 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:43.506+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:43.561 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:43.551+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:43.836 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:43.826+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:43.919 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:43.911+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:44.069 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:44.061+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:44.073 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:44.059+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:44.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:44.294+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:44.512 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:44.502+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:44.574 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:44.564+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:44.810 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:44.800+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:44.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:44.936+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:45.045 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:45.036+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:45.063 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:45.052+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:45.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:45.333+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:45.535 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:45.524+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:45.560 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:45.549+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:45.783 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:45.772+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:45.907 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:45.900+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:46.026 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:46.019+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:46.118 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:46.108+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:46.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:46.341+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:46.541 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:46.531+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:46.600 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:46.589+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:46.799 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:46.788+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:46.866 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:46.859+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:47.000 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:46.992+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:47.095 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:36:47.088+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e287 v287) 2019-12-11T19:36:47.098 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:47.089+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:47.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:47.306+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:47.578 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:47.569+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:47.652 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:47.641+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:47.838 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:47.828+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:47.897 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:47.889+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:47.996 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:47.989+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:48.138 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:48.129+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:48.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:48.344+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:48.551 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:48.541+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:48.703 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:48.692+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:48.812 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:48.801+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:48.930 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:48.921+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:48.975 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:48.966+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:49.159 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:49.149+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:49.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:49.383+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:49.529 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:49.520+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:49.730 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:49.720+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:49.823 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:49.814+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:49.986 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:49.978+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:49.987 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:49.980+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:50.182 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:50.173+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:50.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:50.406+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:50.507 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:50.499+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:50.771 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:50.761+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:50.878 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:50.868+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:50.990 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:50.982+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:51.024 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:51.016+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:51.205 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:51.193+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:51.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:51.390+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:51.552 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:51.543+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:36:51.802 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:36:51.790+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.053743+0000 front 2019-12-11T19:35:26.128587+0000 (oldest deadline 2019-12-11T19:36:08.932247+0000) 2019-12-11T19:36:51.897 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:36:51.888+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.414244+0000 front 2019-12-11T19:35:28.476520+0000 (oldest deadline 2019-12-11T19:36:10.642407+0000) 2019-12-11T19:36:51.950 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:36:51.943+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.527433+0000 front 2019-12-11T19:35:26.951818+0000 (oldest deadline 2019-12-11T19:36:09.224403+0000) 2019-12-11T19:36:52.024 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:36:52.017+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:26.575690+0000 front 2019-12-11T19:35:26.757053+0000 (oldest deadline 2019-12-11T19:36:10.038031+0000) 2019-12-11T19:36:52.153 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:36:52.147+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 43sec e287 v287) 2019-12-11T19:36:52.251 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:36:52.243+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:28.041614+0000 front 2019-12-11T19:35:28.251275+0000 (oldest deadline 2019-12-11T19:36:10.927117+0000) 2019-12-11T19:36:52.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:36:52.369+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.101667+0000 front 2019-12-11T19:35:26.809699+0000 (oldest deadline 2019-12-11T19:36:12.656962+0000) 2019-12-11T19:36:52.539 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:36:52.531+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:35:27.528065+0000 front 2019-12-11T19:35:27.529716+0000 (oldest deadline 2019-12-11T19:36:12.609666+0000) 2019-12-11T19:37:49.546 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:49.537+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:50.211 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:50.203+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:50.504 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:50.496+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:51.258 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:51.250+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:51.525 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:51.510+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:51.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:51.620+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:52.301 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:52.292+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:52.490 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:52.482+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:52.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:52.625+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:53.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:53.252+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:53.343 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:53.335+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:53.451 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:53.444+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:53.473 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:53.465+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:53.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:53.615+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:54.136 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:54.129+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:54.290 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:54.283+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:54.338 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:54.327+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:54.468 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:54.459+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:54.481 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:54.473+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:54.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:54.597+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:55.184 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:55.178+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:55.247 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:55.239+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:55.350 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:55.342+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:55.428 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:55.420+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:55.473 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:55.464+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:55.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:55.564+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:56.163 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:56.156+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:56.285 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:56.277+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:56.319 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:56.310+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:56.441 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:56.432+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:56.519 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:56.510+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:56.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:56.611+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:57.120 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:57.113+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:57.284 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:57.275+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:57.322 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:57.310+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:57.469 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:57.461+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:57.490 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:57.482+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:57.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:57.612+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:58.098 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:58.090+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:58.290 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:58.281+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:58.349 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:58.342+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:58.523 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:58.515+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:58.533 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:58.524+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:58.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:58.664+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:37:59.133 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:37:59.126+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:37:59.278 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:37:59.270+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:37:59.327 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:37:59.321+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:37:59.490 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:37:59.481+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:37:59.549 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:37:59.540+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:37:59.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:37:59.626+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:00.129 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:00.118+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:00.258 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:00.248+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:00.299 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:00.290+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:00.512 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:00.503+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:00.542 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:00.533+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:00.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:00.678+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:01.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:01.094+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:01.262 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:01.254+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:01.302 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:01.290+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:01.503 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:01.495+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:01.540 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:01.531+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:01.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:01.655+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:02.127 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:02.120+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:02.264 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:02.256+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:02.330 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:02.323+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:02.556 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:02.547+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:02.568 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:02.560+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:02.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:02.629+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:03.140 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:03.132+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:03.269 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:03.256+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:03.337 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:03.329+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:03.549 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:03.541+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:03.558 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:03.551+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:03.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:03.670+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:03.796 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:03.786+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:04.174 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:04.167+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:04.304 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:04.295+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:04.311 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:04.303+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:04.559 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:04.551+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:04.570 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:04.561+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:04.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:04.630+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:04.763 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:04.757+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:05.144 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:05.136+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:05.324 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:05.316+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:05.362 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:05.355+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:05.527 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:05.519+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:05.614 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:05.605+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:05.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:05.662+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:05.807 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:05.797+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:05.809 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:05.801+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:06.163 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:06.156+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:06.322 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:06.313+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:06.398 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:06.392+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:06.580 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:06.570+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:06.584 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:06.576+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:06.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:06.687+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:06.802 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:06.793+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:06.803 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:06.795+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:07.186 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:07.178+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:07.288 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:07.278+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:07.387 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:07.379+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:07.553 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:07.539+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:07.628 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:07.621+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:07.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:07.725+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:07.849 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:07.842+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:07.853 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:07.846+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:08.216 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:08.208+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:08.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:08.317+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:08.355 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:08.348+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:08.579 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:08.571+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:08.642 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:08.634+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:08.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:08.754+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:08.866 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:08.859+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:08.868 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:08.861+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:09.174 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:09.168+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:09.316 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:09.308+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:09.351 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:09.343+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:09.575 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:09.567+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:09.678 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:09.669+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:09.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:09.716+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:09.857 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:09.849+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:09.858 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:09.850+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:10.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:10.192+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:10.288 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:10.280+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:10.321 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:10.314+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:10.562 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:10.554+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:10.696 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:10.687+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:10.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:10.757+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:10.898 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:10.890+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:10.899 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:10.892+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:11.249 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:11.241+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:11.289 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:11.281+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:11.318 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:11.308+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:11.603 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:11.595+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:11.726 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:11.718+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:11.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:11.719+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:11.917 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:11.909+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:11.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:11.910+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:12.237 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:12.230+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:12.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:12.257+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:12.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:12.317+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:12.656 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:12.646+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:12.693 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:12.683+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:12.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:12.699+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:12.943 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:12.935+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:12.943 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:12.937+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:13.263 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:13.256+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:13.265 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:13.258+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:13.294 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:13.284+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:13.658 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:13.647+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:13.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:13.654+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:13.692 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:13.683+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:13.969 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:13.961+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:13.970 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:13.963+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:14.252 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:14.244+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:14.269 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:14.259+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:14.291 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:14.284+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:14.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:14.649+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:14.684 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:14.674+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:14.742 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:14.732+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:14.990 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:14.982+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:14.990 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:14.984+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:15.250 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:15.243+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:15.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:15.272+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:15.305 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:15.297+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:15.650 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:15.642+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:15.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:15.645+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:15.701 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:15.690+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:16.016 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:16.010+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:16.019 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:16.012+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:16.216 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:16.210+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:16.257 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:16.248+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:16.325 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:16.318+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:16.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:16.646+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:16.673 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:16.663+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:16.753 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:16.744+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:17.037 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:17.030+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:17.038 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:17.032+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:17.265 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:17.258+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:17.266 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:17.257+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:17.290 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:17.282+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:17.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:17.668+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:17.698 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:17.682+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:17.711 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:17.701+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:18.072 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:18.065+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:18.073 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:18.066+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:18.224 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:18.215+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:18.309 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:18.301+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:18.314 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:18.307+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:18.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:18.681+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:18.710 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:18.700+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:18.728 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:18.719+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:19.124 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:19.116+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:19.125 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:19.117+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:19.235 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:19.226+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:19.311 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:19.303+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:19.343 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:19.336+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:19.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:19.661+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:19.671 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:19.662+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:19.696 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:19.686+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:20.119 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:20.112+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:20.124 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:20.115+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:20.197 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:20.187+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:20.308 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:20.301+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:20.324 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:20.316+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:20.688 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:20.678+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:20.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:20.703+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:20.737 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:20.728+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:21.110 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:21.103+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:21.114 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:21.107+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:21.177 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:21.167+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:21.282 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:21.274+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:21.362 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:21.355+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:21.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:21.677+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:21.719 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:21.710+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:21.733 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:21.724+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:22.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:22.146+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:22.154 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:22.148+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:22.213 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:22.203+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:22.304 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:22.297+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:22.354 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:22.347+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:22.726 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:22.717+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:22.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:22.722+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:22.757 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:22.748+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:23.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:23.106+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:23.117 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:23.109+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:23.253 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:23.244+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:23.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:23.339+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:23.378 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:23.371+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:23.681 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:23.672+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:23.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:23.730+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:23.754 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:23.740+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:24.168 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:24.160+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:24.170 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:24.162+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:24.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:24.237+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:24.326 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:24.317+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:24.368 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:24.360+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:24.653 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:24.644+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:24.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:24.739+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:24.802 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:24.788+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:25.192 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:25.182+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:25.193 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:25.184+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:25.214 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:25.206+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:25.328 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:25.319+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:25.349 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:25.339+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:25.674 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:25.666+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:25.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:25.700+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:25.806 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:25.797+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:26.193 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:26.183+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:26.194 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:26.186+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:26.254 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:26.245+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:26.306 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:26.298+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:26.310 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:26.303+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:26.682 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:26.674+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:26.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:26.741+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:26.807 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:26.799+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:27.216 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:27.207+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:27.218 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:27.209+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:27.252 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:27.244+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:27.302 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:27.296+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:27.303 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:27.295+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:27.487 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:38:27.477+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e294 v294) 2019-12-11T19:38:27.686 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:27.677+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:27.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:27.762+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:27.812 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:27.804+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:28.215 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:28.208+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:28.236 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:28.228+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:28.236 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:28.230+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:28.300 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:28.293+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:28.347 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:28.340+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:28.715 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:28.707+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:28.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:28.741+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:28.865 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:28.857+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:29.240 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:29.231+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:29.260 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:29.252+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:29.285 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:29.278+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:29.289 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:29.282+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:29.324 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:29.316+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:29.677 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:29.666+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:29.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:29.763+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:29.839 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:29.830+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:30.234 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:30.226+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:30.253 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:30.246+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:30.319 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:30.312+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:30.324 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:30.316+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:30.374 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:30.367+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:30.670 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:30.662+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:30.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:30.728+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:30.850 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:30.841+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:31.209 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:31.200+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:31.243 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:31.236+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:31.281 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:31.270+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:31.283 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:31.275+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:31.366 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:31.359+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:31.653 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:31.645+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:31.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:31.733+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:31.868 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:31.860+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:32.230 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:32.222+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:32.259 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:32.251+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:32.300 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:32.292+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:32.301 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:32.293+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:32.413 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:32.406+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:32.608 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:38:32.492+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e294 v294) 2019-12-11T19:38:32.640 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:32.632+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:32.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:32.704+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:32.856 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:32.848+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:33.223 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:33.214+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:33.253 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:33.245+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:33.343 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:33.334+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:33.345 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:33.337+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:33.370 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:33.363+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:33.647 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:33.638+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:33.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:33.711+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:33.902 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:33.893+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:34.222 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:34.215+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:34.248 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:34.239+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:34.319 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:34.312+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:34.323 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:34.316+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:34.381 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:34.374+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:34.688 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:34.671+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:34.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:34.718+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:34.860 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:34.852+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:35.221 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:35.213+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:35.259 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:35.251+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:35.361 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:35.352+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:35.363 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:35.355+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:35.436 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:35.429+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:35.693 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:35.684+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:35.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:35.694+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:35.908 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:35.900+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:36.208 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:36.199+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:36.227 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:36.219+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:36.382 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:36.375+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:36.385 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:36.378+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:36.442 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:36.435+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:36.702 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:36.693+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:36.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:36.707+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:38:36.901 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:38:36.892+0000 1694f700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:09.924493+0000 front 2019-12-11T19:37:09.921431+0000 (oldest deadline 2019-12-11T19:37:48.982110+0000) 2019-12-11T19:38:37.220 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:38:37.212+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.798290+0000 front 2019-12-11T19:37:05.800795+0000 (oldest deadline 2019-12-11T19:37:53.871015+0000) 2019-12-11T19:38:37.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:38:37.265+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:06.946819+0000 front 2019-12-11T19:37:07.052526+0000 (oldest deadline 2019-12-11T19:37:49.616863+0000) 2019-12-11T19:38:37.399 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:37.387+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:37:25.206825+0000 (oldest deadline 2019-12-11T19:38:05.206825+0000) 2019-12-11T19:38:37.401 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:38:37.390+0000 1694f700 -1 osd.2 294 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4349.0:105744 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e291) 2019-12-11T19:38:37.422 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:38:37.414+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:08.600320+0000 front 2019-12-11T19:37:08.558581+0000 (oldest deadline 2019-12-11T19:37:52.683322+0000) 2019-12-11T19:38:37.550 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:38:37.540+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e294 v294) 2019-12-11T19:38:37.701 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:38:37.693+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:10.062014+0000 front 2019-12-11T19:37:10.041457+0000 (oldest deadline 2019-12-11T19:37:52.760852+0000) 2019-12-11T19:38:37.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:38:37.712+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:37:05.781808+0000 front 2019-12-11T19:37:06.046860+0000 (oldest deadline 2019-12-11T19:37:50.864773+0000) 2019-12-11T19:39:13.060 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:13.276 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.064 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:13.281 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.075 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:13.249 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.084 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:13.257 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.109 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:13.325 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.110 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:13.327 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.278 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:13.494 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.306 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:13.523 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:13.309 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:13.482 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.270 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:39.485 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.280 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:39.494 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.295 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:39.512 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.299 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:39.473 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.309 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:39.526 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.313 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:39.487 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.373 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:05:57:39.589 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.373 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:05:57:39.589 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:39:39.443 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:05:57:39.617 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:40:11.852 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:11.843+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:12.159 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:12.153+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:12.223 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:12.214+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:12.869 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:12.859+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:13.127 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:13.120+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:13.182 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:13.173+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:13.893 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:13.885+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:14.112 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:14.102+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:14.158 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:14.147+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:14.219 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:14.210+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:14.333 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:14.323+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:14.914 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:14.905+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:15.123 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:15.116+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:15.178 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:15.170+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:15.200 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:15.191+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:15.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:15.197+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:15.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:15.281+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:15.354 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:15.342+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:15.893 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:15.884+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:16.106 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:16.099+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:16.134 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:16.127+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:16.192 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:16.183+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:16.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:16.247+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:16.293 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:16.284+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:16.345 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:16.335+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:16.946 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:16.937+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:17.132 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:17.124+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:17.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:17.138+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:17.221 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:17.213+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:17.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:17.284+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:17.310 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:17.301+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:17.377 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:17.367+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:17.947 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:17.937+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:18.140 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:18.131+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:18.187 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:18.178+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:18.228 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:18.218+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:18.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:18.251+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:18.335 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:18.325+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:18.400 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:18.389+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:18.968 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:18.957+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:19.158 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:19.150+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:19.167 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:19.160+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:19.192 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:19.183+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:19.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:19.211+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:19.354 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:19.346+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:19.398 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:19.388+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:19.979 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:19.970+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:20.117 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:20.110+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:20.151 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:20.143+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:20.168 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:20.161+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:20.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:20.193+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:20.390 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:20.380+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:20.392 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:20.383+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:20.938 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:20.930+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:21.080 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:21.072+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:21.126 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:21.118+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:21.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:21.186+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:21.199 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:21.189+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:21.371 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:21.361+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:21.437 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:21.427+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:21.947 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:21.934+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:22.131 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:22.119+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:22.142 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:22.135+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:22.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:22.154+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:22.195 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:22.186+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:22.338 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:22.328+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:22.464 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:22.455+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:22.959 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:22.949+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:23.107 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:23.100+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:23.124 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:23.118+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:23.177 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:23.168+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:23.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:23.182+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:23.311 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:23.301+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:23.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:23.508+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:23.928 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:23.919+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:24.102 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:24.090+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:24.109 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:24.102+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:24.166 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:24.157+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:24.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:24.170+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:24.280 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:24.269+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:24.569 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:24.560+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:24.965 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:24.955+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:25.065 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:25.056+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:25.154 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:25.146+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:25.197 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:25.188+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:25.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:25.195+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:25.317 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:25.307+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:25.621 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:25.611+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:25.981 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:25.972+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:26.039 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:26.030+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:26.202 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:26.195+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:26.236 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:26.224+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:26.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:26.243+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:26.335 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:26.325+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:26.582 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:26.573+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:27.000 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:26.990+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:27.090 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:40:27.081+0000 1694f700 -1 osd.0 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.950812+0000 front 2019-12-11T19:39:29.942409+0000 (oldest deadline 2019-12-11T19:40:11.982536+0000) 2019-12-11T19:40:27.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:27.200+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:27.226 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:27.217+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:27.257 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:27.247+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:27.368 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:27.359+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:27.625 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:27.616+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:27.981 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:27.971+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:28.227 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:28.220+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:28.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:28.228+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:28.257 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:28.247+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:28.421 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:28.411+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:28.630 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:28.620+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:29.005 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:28.996+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:29.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:29.198+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:29.270 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:29.263+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:29.300 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:29.291+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:29.439 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:29.430+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:29.620 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:29.610+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:29.987 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:29.977+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:30.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:30.235+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:30.255 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:30.245+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:30.292 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:30.284+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:30.414 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:30.404+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:30.608 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:30.598+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:31.013 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:31.003+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:31.240 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:31.230+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:31.271 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:31.264+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:31.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:31.279+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:31.442 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:31.432+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:31.592 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:31.581+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:32.000 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:31.991+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:32.205 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:32.196+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:32.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:32.252+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:32.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:32.283+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:32.402 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:32.393+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:32.584 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:32.575+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:33.047 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:33.038+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:33.230 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:33.221+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:33.254 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:33.246+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:33.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:33.277+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:33.403 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:33.394+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:33.595 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:33.586+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:34.064 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:34.055+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:34.215 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:34.206+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:34.248 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:34.233+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:34.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:34.284+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:34.409 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:34.399+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:34.610 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:34.600+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:35.027 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:35.016+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:35.218 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:35.209+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:35.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:35.258+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:35.270 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:35.261+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:35.459 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:35.449+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:35.628 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:35.619+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:36.033 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:36.020+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:36.258 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:36.249+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:36.259 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:36.250+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:36.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:36.257+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:36.449 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:36.439+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:36.659 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:36.650+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:36.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:36.976+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:37.223 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:37.216+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:37.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:37.263+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:37.288 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:37.277+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:37.412 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:37.401+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:37.708 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:37.697+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:38.036 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:38.025+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:38.235 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:38.228+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:38.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:38.282+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:38.309 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:38.299+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:38.435 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:38.424+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:38.712 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:38.702+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:39.065 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:39.055+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:39.272 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:39.266+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:39.300 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:39.289+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:39.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:39.326+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:39.417 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:39.407+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:39.677 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:39.666+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:40.037 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:40.027+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:40.233 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:40.225+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:40.270 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:40.259+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:40.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:40.299+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:40.447 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:40.436+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:40.693 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:40.683+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:41.064 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:41.054+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:41.268 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:41.261+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:41.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:41.297+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:41.313 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:41.303+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:41.412 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:41.401+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:41.743 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:41.732+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:42.071 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:42.061+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:42.228 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:42.219+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:42.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:42.345+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:42.362 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:42.352+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:42.457 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:42.441+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:42.773 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:42.761+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:43.104 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:43.094+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:43.201 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:43.193+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:43.208 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:40:43.201+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 44sec e299 v299) 2019-12-11T19:40:43.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:43.302+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:43.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:43.318+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:43.444 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:43.433+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:43.775 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:43.764+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:44.106 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:44.095+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:44.232 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:44.224+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:44.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:44.273+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:44.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:44.304+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:44.489 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:44.478+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:44.794 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:44.783+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:45.080 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:45.070+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:45.270 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:45.263+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:45.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:45.275+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:45.315 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:45.304+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:45.470 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:45.460+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:45.842 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:45.832+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:46.111 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:46.101+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:46.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:46.266+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:46.308 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:46.301+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:46.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:46.304+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:46.428 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:46.417+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:46.854 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:46.844+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:47.118 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:47.108+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:47.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:47.232+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:47.342 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:47.335+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:47.366 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:47.355+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:47.426 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:47.416+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:47.853 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:47.841+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:48.094 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:48.084+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:48.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:48.197+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:48.218 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:40:48.212+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 44sec e299 v299) 2019-12-11T19:40:48.310 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:48.303+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:48.400 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:48.389+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:48.462 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:48.451+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:48.887 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:48.877+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:49.079 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:49.068+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:49.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:49.230+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:49.349 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:49.342+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:49.402 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:49.392+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:49.512 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:49.500+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:49.883 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:49.873+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:50.123 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:50.114+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:50.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:50.218+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:50.386 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:50.378+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:50.435 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:50.426+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:50.526 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:50.517+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:50.892 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:50.883+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:51.145 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:51.135+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:51.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:51.181+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:51.345 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:51.337+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:51.471 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:51.461+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:51.560 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:51.550+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:51.940 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:51.929+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:52.118 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:52.109+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:52.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:52.149+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:52.346 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:40:52.339+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.477914+0000 front 2019-12-11T19:39:29.402948+0000 (oldest deadline 2019-12-11T19:40:13.471768+0000) 2019-12-11T19:40:52.456 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:52.446+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:40:52.528 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:40:52.519+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:31.312172+0000 front 2019-12-11T19:39:31.372422+0000 (oldest deadline 2019-12-11T19:40:14.347921+0000) 2019-12-11T19:40:52.985 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:40:52.976+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:29.958813+0000 front 2019-12-11T19:39:30.280110+0000 (oldest deadline 2019-12-11T19:40:13.431986+0000) 2019-12-11T19:40:53.103 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:40:53.093+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:28.475050+0000 front 2019-12-11T19:39:28.476499+0000 (oldest deadline 2019-12-11T19:40:11.347725+0000) 2019-12-11T19:40:53.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:40:53.192+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:30.500397+0000 front 2019-12-11T19:39:30.523264+0000 (oldest deadline 2019-12-11T19:40:14.288773+0000) 2019-12-11T19:40:53.261 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:40:53.254+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 44sec e299 v299) 2019-12-11T19:40:53.506 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:40:53.498+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:39:26.523094+0000 front 2019-12-11T19:39:26.514970+0000 (oldest deadline 2019-12-11T19:40:12.091806+0000) 2019-12-11T19:41:34.511 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.484+0000 31786700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:34.558 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.531+0000 31786700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:34.692 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.649+0000 31f87700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:34.729 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.656+0000 31f87700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:34.740 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.692+0000 35f8f700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:34.770 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:34.756+0000 32788700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:35.418 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:35.329+0000 3578e700 -1 osd.2 304 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:38.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:41:38.140+0000 37f93700 -1 osd.2 305 build_incremental_map_msg missing incremental map 304 2019-12-11T19:41:50.278 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:50.270+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:50.302 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:50.295+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:50.306 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:50.299+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:51.139 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:51.131+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:51.269 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:51.260+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:51.331 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:51.315+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:51.354 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:51.346+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:52.188 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:52.179+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:52.243 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:52.234+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:52.314 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:52.306+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:52.333 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:52.326+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:53.241 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:53.232+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:53.242 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:53.234+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:53.317 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:53.309+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:53.347 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:53.340+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:54.268 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:54.259+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:54.290 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:54.282+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:54.298 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:54.290+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:54.381 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:54.375+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:54.880 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:54.872+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:41:55.280 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:55.272+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:55.307 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:55.298+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:55.323 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:55.315+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:55.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:55.396+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:55.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:41:55.590+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:41:55.845 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:55.839+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:41:56.249 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:56.240+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:56.336 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:56.327+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:56.357 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:56.348+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:56.360 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:56.353+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:56.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:41:56.632+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:41:56.837 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:56.827+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:41:57.209 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:57.200+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:57.327 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:57.318+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:57.357 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:57.349+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:57.360 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:57.353+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:57.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:41:57.617+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:41:57.801 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:57.794+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:41:58.264 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:58.254+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:58.325 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:58.306+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:58.340 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:58.331+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:58.350 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:58.342+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:58.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:41:58.577+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:41:58.841 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:58.835+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:41:59.254 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:41:59.245+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:41:59.282 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:41:59.275+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:41:59.362 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:41:59.354+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:41:59.368 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:41:59.359+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:41:59.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:41:59.594+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:41:59.798 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:41:59.790+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:00.228 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:00.219+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:00.321 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:00.313+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:00.324 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:00.315+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:00.379 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:00.371+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:00.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:00.626+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:00.806 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:00.798+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:01.197 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:01.189+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:01.282 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:01.273+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:01.352 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:01.344+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:01.371 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:01.363+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:01.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:01.658+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:01.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:01.767+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:02.227 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:02.219+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:02.251 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:02.243+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:02.316 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:02.308+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:02.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:02.372+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:02.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:02.630+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:02.744 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:02.735+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:03.238 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:03.229+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:03.271 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:03.261+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:03.286 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:03.277+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:03.364 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:03.355+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:03.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:03.679+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:03.789 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:03.781+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:04.199 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:04.190+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:04.295 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:04.287+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:04.328 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:04.320+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:04.411 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:04.403+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:04.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:04.640+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:04.749 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:04.741+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:04.779 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:04.772+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:05.210 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:05.202+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:05.302 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:05.294+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:05.341 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:05.334+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:05.375 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:05.367+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:05.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:05.615+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:05.721 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:05.714+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:05.815 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:05.807+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:06.251 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:06.242+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:06.349 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:06.340+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:06.374 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:06.367+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:06.406 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:06.398+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:06.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:06.640+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:06.772 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:06.764+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:06.787 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:06.780+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:07.263 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:07.255+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:07.323 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:07.315+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:07.416 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:07.409+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:07.434 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:07.425+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:07.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:07.647+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:07.764 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:07.757+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:07.806 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:07.799+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:08.244 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:08.236+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:08.326 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:08.317+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:08.393 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:08.385+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:08.413 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:08.406+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:08.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:08.632+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:08.730 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:08.723+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:08.796 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:08.789+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:09.216 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:09.207+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:09.331 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:09.323+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:09.353 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:09.344+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:09.406 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:09.399+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:09.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:09.669+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:09.746 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:09.740+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:09.766 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:09.758+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:10.232 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:10.223+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:10.369 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:10.361+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:10.369 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:10.360+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:10.372 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:10.363+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:10.712 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:10.705+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:10.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:10.714+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:10.778 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:10.770+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:11.222 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:11.212+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:11.345 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:11.338+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:11.372 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:11.364+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:11.421 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:11.413+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:11.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:11.675+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:11.734 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:11.726+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:11.735 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:11.728+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:11.777 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:11.771+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:12.263 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:12.255+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:12.333 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:12.325+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:12.350 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:12.341+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:12.412 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:12.403+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:12.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:12.672+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:12.725 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:12.717+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:12.726 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:12.719+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:12.802 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:12.795+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:13.291 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:13.282+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:13.354 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:13.347+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:13.397 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:13.388+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:13.405 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:13.396+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:13.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:13.660+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:13.745 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:13.736+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:13.748 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:13.740+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:13.788 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:13.780+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:14.295 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:14.287+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:14.309 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:14.302+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:14.367 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:14.357+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:14.422 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:14.412+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:14.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:14.660+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:14.718 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:14.710+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:14.719 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:14.712+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:14.829 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:14.822+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:15.252 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:15.243+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:15.305 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:15.298+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:15.380 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:15.369+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:15.408 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:15.398+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:15.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:15.682+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:15.703 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:15.695+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:15.704 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:15.697+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:15.785 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:15.778+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:16.258 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:16.248+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:16.288 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:16.280+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:16.412 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:16.399+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:16.415 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:16.406+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:16.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:16.700+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:16.755 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:16.747+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:16.757 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:16.748+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:16.828 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:16.821+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:17.253 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:17.245+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:17.312 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:17.302+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:17.392 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:17.381+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:17.439 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:17.430+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:17.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:17.659+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:17.762 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:17.755+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:17.765 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:17.758+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:17.841 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:17.833+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:18.279 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:18.272+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:18.288 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:18.278+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:18.403 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:18.393+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:18.482 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:18.473+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:18.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:18.700+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:18.789 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:18.783+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:18.792 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:18.786+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:18.866 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:18.858+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:19.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:19.263+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:19.277 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:19.270+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:19.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:19.404+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:19.526 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:19.516+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:19.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:19.738+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:19.838 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:19.830+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:19.839 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:19.832+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:19.877 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:19.870+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:20.244 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:20.237+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:20.292 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:20.282+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:20.400 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:20.387+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:20.504 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:20.494+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:20.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:20.737+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:20.806 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:20.797+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:20.808 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:20.800+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:20.911 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:20.904+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:21.228 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:21.221+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:21.303 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:21.293+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:21.432 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:21.422+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:21.542 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:21.532+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:21.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:21.708+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:21.784 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:21.775+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:21.785 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:21.777+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:21.878 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:21.871+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:22.198 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:22.191+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:22.340 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:22.330+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:22.461 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:22.451+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:22.550 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:22.542+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:22.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:22.678+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:22.748 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:22.740+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:22.748 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:22.742+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:22.869 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:22.861+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:23.157 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:23.150+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:23.371 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:23.361+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:23.456 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:23.447+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:23.551 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:23.543+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:23.567 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:23.558+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:23.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:23.726+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:23.756 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:23.748+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:23.756 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:23.749+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:23.888 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:23.881+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:24.185 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:24.173+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:24.388 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:24.377+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:24.510 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:24.501+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:24.556 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:24.547+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:24.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:24.721+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:24.792 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:24.785+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:24.797 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:24.789+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:24.924 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:24.916+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:25.179 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:25.172+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:25.399 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:25.384+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:25.525 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:25.515+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:25.587 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:25.578+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:25.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:25.684+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:25.816 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:25.810+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:25.820 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:25.813+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:25.894 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:25.884+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:26.180 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:26.173+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:26.436 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:26.427+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:26.548 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:26.538+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:26.556 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:26.547+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:26.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:26.660+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:26.868 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:26.861+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:26.872 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:26.864+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:26.923 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:26.916+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:27.142 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:27.135+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:27.463 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:27.455+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:27.556 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:27.547+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:27.590 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:27.581+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:27.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:27.681+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:27.875 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:27.867+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:27.877 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:27.869+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:27.912 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:27.905+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:28.149 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:28.142+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:28.480 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:28.469+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:28.545 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:28.536+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:28.574 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:28.565+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:28.642 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:28.634+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:28.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:28.663+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:28.836 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:28.827+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:28.837 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:28.830+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:28.877 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:28.869+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:29.191 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:29.184+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:29.460 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:29.451+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:29.547 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:29.539+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:29.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:29.624+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:29.687 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:29.678+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:29.796 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:29.788+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:29.798 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:29.790+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:29.911 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:29.903+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:30.207 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:30.200+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:30.450 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:30.441+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:30.534 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:30.526+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:30.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:30.614+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:30.699 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:30.691+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:30.821 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:30.813+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:30.822 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:30.814+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:30.919 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:30.912+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:31.169 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:31.161+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:31.424 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:31.416+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:31.530 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:31.522+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:31.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:31.627+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:31.661 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:31.653+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:31.871 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:31.862+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:31.873 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:31.865+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:31.911 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:31.904+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:32.156 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:32.149+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:32.431 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:32.422+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:32.487 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:32.478+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:32.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:32.613+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:32.694 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:32.685+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:32.845 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:32.838+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:32.849 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:32.842+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:32.905 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:32.899+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:33.203 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:33.195+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:33.449 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:33.440+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:33.454 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:33.446+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:33.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:33.570+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:33.662 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:33.654+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:33.717 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:33.710+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:33.780 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:00:33.996 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.784 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:00:34.000 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.828 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:00:34.044 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.829 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:00:34.046 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:00:34.039 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.869 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:00:34.042 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:33.890 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:33.881+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:33.892 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:33.883+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:33.907 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:33.901+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:33.926 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:00:34.143 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:34.006 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:00:34.223 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:34.024 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:00:34.197 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:42:34.162 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:34.156+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:34.458 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:34.450+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:34.481 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:34.473+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:34.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:34.551+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:34.641 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:34.633+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:34.887 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:34.880+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:34.892 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:34.885+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:34.936 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:34.929+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:35.211 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:35.205+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:35.473 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:35.465+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:35.515 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:35.507+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:35.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:35.579+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:35.669 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:35.661+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:35.892 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:35.886+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:35.894 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:35.888+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:35.965 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:35.958+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:36.256 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:36.249+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:36.487 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:36.478+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:36.521 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:36.512+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:36.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:36.576+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:36.679 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:36.670+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:36.877 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:36.871+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:36.882 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:36.875+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:37.016 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:37.008+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:37.300 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:37.293+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:37.516 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:37.506+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:37.539 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:37.531+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:37.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:37.559+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:37.642 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:37.634+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:37.915 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:37.909+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:37.918 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:37.912+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:37.981 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:37.974+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:38.350 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:38.342+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:38.521 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:38.513+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:38.533 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:38.522+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:38.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:38.584+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:38.655 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:38.647+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:38.791 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:38.729+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:38.876 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:38.868+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:38.877 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:38.869+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:38.940 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:38.934+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:39.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:39.339+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:39.511 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:39.502+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:39.520 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:39.511+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:39.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:39.558+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:39.710 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:39.701+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:39.929 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:39.920+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:39.930 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:39.922+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:39.994 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:39.987+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:40.362 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:40.355+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:40.498 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:40.489+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:40.531 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:40.522+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:40.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:40.555+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:40.759 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:40.750+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:40.948 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:40.939+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:40.949 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:40.941+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:41.023 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:41.016+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:41.409 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:41.402+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:41.478 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:41.470+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:41.489 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:41.481+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:41.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:41.566+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:41.810 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:41.801+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:41.997 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:41.989+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:41.998 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:41.991+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:42.066 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:42.059+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:42.435 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:42.428+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:42.449 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:42.441+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:42.505 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:42.496+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:42.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:42.583+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:42.790 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:42.782+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:42.953 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:42.945+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:42.953 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:42.947+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:43.112 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:43.105+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:43.440 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:43.432+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:43.456 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:43.448+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:43.465 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:43.458+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:43.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:43.555+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:43.750 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:43.742+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:43.750 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:43.743+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:43.916 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:43.907+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:43.917 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:43.908+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:44.087 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:44.079+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:44.425 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:44.417+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:44.492 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:44.484+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:44.505 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:44.496+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:44.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:44.603+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:44.762 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:44.753+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:44.922 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:44.915+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:44.924 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:44.917+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:45.127 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:45.119+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:45.414 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:45.406+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:45.506 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:45.497+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:45.539 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:45.530+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:45.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:45.590+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:45.779 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:45.771+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:45.938 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:45.928+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:45.938 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:45.930+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:46.110 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:46.102+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:46.466 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:46.458+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:46.501 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:46.493+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:46.563 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:46.554+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:46.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:46.586+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:46.813 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:46.805+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:46.945 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:46.937+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:46.948 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:46.940+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:47.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:47.068+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:47.469 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:47.461+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:47.479 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:47.471+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:47.556 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:47.547+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:47.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:47.554+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:47.800 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:47.791+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:47.931 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:47.924+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:47.935 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:47.928+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:48.029 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:42:48.022+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.636854+0000 front 2019-12-11T19:41:09.450076+0000 (oldest deadline 2019-12-11T19:41:53.914101+0000) 2019-12-11T19:42:48.482 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:42:48.473+0000 1694f700 -1 osd.6 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:07.034436+0000 front 2019-12-11T19:41:06.982054+0000 (oldest deadline 2019-12-11T19:41:50.106858+0000) 2019-12-11T19:42:48.496 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:42:48.489+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:08.229802+0000 front 2019-12-11T19:41:09.754191+0000 (oldest deadline 2019-12-11T19:41:50.267602+0000) 2019-12-11T19:42:48.524 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:42:48.516+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:05.826030+0000 front 2019-12-11T19:41:05.911292+0000 (oldest deadline 2019-12-11T19:41:49.739498+0000) 2019-12-11T19:42:48.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:48.536+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:42:48.789 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:42:48.780+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.136465+0000 front 2019-12-11T19:41:10.087927+0000 (oldest deadline 2019-12-11T19:41:50.899320+0000) 2019-12-11T19:42:48.838 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:42:48.832+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 45sec e305 v305) 2019-12-11T19:42:48.916 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:48.901+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:41:30.769553+0000 (oldest deadline 2019-12-11T19:42:10.769553+0000) 2019-12-11T19:42:48.919 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:48.903+0000 1694f700 -1 osd.2 305 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e303) 2019-12-11T19:42:49.393 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:42:49.216+0000 31786700 -1 osd.2 306 build_incremental_map_msg missing incremental map 304 2019-12-11T19:42:49.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:42:49.536+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:41:10.100738+0000 front 2019-12-11T19:41:10.137324+0000 (oldest deadline 2019-12-11T19:41:55.042556+0000) 2019-12-11T19:43:14.910 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:14.771+0000 31f87700 -1 osd.7 311 build_incremental_map_msg missing incremental map 311 2019-12-11T19:43:15.000 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:14.972+0000 3378a700 -1 osd.7 311 build_incremental_map_msg missing incremental map 311 2019-12-11T19:43:15.865 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:15.827+0000 31f87700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:15.912 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:15.880+0000 3578e700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:15.966 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:15.918+0000 31f87700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:16.210 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:16.147+0000 3378a700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:16.468 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:16.313+0000 3578e700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:18.043 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:43:18.034+0000 35f8f700 -1 osd.7 312 build_incremental_map_msg missing incremental map 312 2019-12-11T19:43:30.950 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:01:31.166 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:30.958 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:01:31.174 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:30.967 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:01:31.183 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:30.970 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:01:31.144 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:30.972 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:01:31.189 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:30.979 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:01:31.153 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:31.042 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:01:31.259 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:31.079 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:01:31.295 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:43:31.083 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:01:31.257 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:44:15.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:15.772+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:16.305 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:16.298+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:16.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:16.781+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:17.084 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:17.074+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:17.340 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:17.333+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:17.723 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:17.713+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:17.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:17.744+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:17.933 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:17.925+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:18.048 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:18.039+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:18.397 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:18.384+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:18.692 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:18.683+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:18.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:18.794+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:18.978 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:18.970+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:19.096 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:19.087+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:19.365 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:19.357+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:19.717 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:19.707+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:19.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:19.765+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:19.959 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:19.951+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:20.134 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:20.124+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:20.180 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:20.170+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:20.324 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:20.316+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:20.730 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:20.720+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:20.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:20.804+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:20.966 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:20.959+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:21.174 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:21.166+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:21.176 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:21.167+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:21.317 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:21.309+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:21.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:21.761+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:21.775 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:21.765+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:21.947 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:21.941+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:22.136 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:22.128+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:22.203 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:22.194+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:22.282 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:22.275+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:22.735 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:22.726+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:22.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:22.743+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:22.986 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:22.978+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:23.140 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:23.131+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:23.189 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:23.179+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:23.284 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:23.276+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:23.765 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:23.755+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:23.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:23.776+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:23.983 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:23.975+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:24.119 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:24.109+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:24.213 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:24.204+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:24.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:24.290+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:24.778 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:24.769+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:24.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:24.773+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:25.012 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:25.003+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:25.167 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:25.159+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:25.199 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:25.189+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:25.273 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:25.267+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:25.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:25.746+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:25.832 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:25.823+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:25.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:25.972+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:26.163 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:26.154+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:26.216 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:26.207+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:26.238 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:26.231+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:26.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:26.782+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:26.824 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:26.815+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:26.986 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:26.978+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:27.197 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:27.187+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:27.205 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:27.197+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:27.249 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:27.240+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:27.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:27.808+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:27.853 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:27.844+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:27.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:27.971+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:28.160 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:28.153+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:28.161 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:28.152+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:28.240 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:28.231+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:28.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:28.789+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:28.886 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:28.876+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:28.961 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:28.953+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:29.130 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:29.122+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:29.131 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:29.122+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:29.251 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:29.242+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:29.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:29.831+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:29.908 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:29.899+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:29.923 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:29.916+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:30.124 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:30.114+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:30.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:30.133+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:30.233 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:30.224+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:30.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:30.791+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:30.869 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:30.860+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:30.894 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:30.886+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:31.092 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:31.082+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:31.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:31.133+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:31.230 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:31.221+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:31.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:31.765+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:31.834 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:31.824+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:31.853 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:31.843+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:32.054 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:32.045+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:32.154 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:32.146+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:32.223 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:32.211+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:32.805 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:32.795+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:32.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:32.815+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:32.842 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:32.835+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:33.082 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:33.072+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:33.199 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:33.191+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:33.261 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:33.251+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:33.829 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:33.821+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:33.839 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:33.830+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:33.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:33.849+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:34.068 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:34.058+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:34.170 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:34.162+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:34.287 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:34.277+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:34.796 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:34.789+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:34.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:34.850+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:34.863 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:34.851+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:35.033 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:35.023+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:35.212 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:35.205+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:35.321 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:35.313+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:35.763 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:35.756+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:35.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:35.877+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:35.913 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:35.904+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:36.000 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:35.990+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:36.174 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:36.167+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:36.302 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:36.294+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:36.731 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:36.724+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:36.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:36.839+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:36.940 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:36.926+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:37.049 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:37.039+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:37.223 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:37.215+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:37.319 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:37.310+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:37.761 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:37.753+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:37.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:37.866+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:37.966 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:37.955+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:38.030 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:38.019+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:38.210 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:38.203+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:38.370 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:38.359+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:38.813 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:38.805+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:38.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:38.873+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:38.994 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:38.982+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:38.999 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:38.988+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:39.167 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:39.159+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:39.405 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:39.394+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:39.841 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:39.833+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:39.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:39.894+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:40.017 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:40.006+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:40.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:40.021+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:40.148 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:40.140+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:40.454 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:40.442+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:40.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:40.873+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:40.882 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:40.875+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:41.033 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:41.023+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:41.044 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:41.034+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:41.153 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:41.145+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:41.506 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:41.496+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:41.915 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:41.906+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:41.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:41.907+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:42.020 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:42.010+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:42.030 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:42.019+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:42.118 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:42.110+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:42.537 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:42.526+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:42.915 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:42.908+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:42.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:42.944+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:43.010 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:43.000+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:43.046 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:43.025+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:43.135 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:43.127+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:43.580 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:43.569+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:43.873 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:43.865+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:43.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:43.899+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:44.005 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:43.994+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:44.010 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:43.999+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:44.142 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:44.135+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:44.559 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:44.548+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:44.879 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:44.865+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:44.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:44.907+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:45.004 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:44.992+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:45.055 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:45.045+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:45.183 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:45.174+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:45.572 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:45.561+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:45.872 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:45.863+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:45.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:45.944+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:46.025 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:46.014+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:46.029 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:46.017+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:46.180 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:46.174+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:46.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:46.532+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:46.859 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:46.853+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:46.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:46.899+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:46.987 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:46.976+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:47.058 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:47.047+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:47.145 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:47.137+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:47.548 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:47.537+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:47.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:47.852+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:47.905 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:47.898+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:48.039 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:48.029+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:48.059 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:48.049+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:48.192 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:48.185+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:48.554 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:48.544+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:48.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:48.867+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:48.935 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:48.928+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:49.093 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:49.082+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:49.109 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:49.098+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:49.141 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:44:49.135+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e312 v312) 2019-12-11T19:44:49.234 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:49.226+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:49.563 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:49.553+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:49.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:49.910+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:49.965 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:49.958+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:50.059 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:50.049+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:50.156 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:50.147+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:50.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:50.257+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:50.527 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:50.518+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:50.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:50.902+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:50.950 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:50.942+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:51.029 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:51.020+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:51.152 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:51.143+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:51.284 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:51.274+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:51.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:51.534+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:51.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:51.896+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:51.962 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:51.955+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:52.053 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:52.044+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:52.157 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:52.148+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:52.291 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:52.283+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:52.575 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:52.566+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:52.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:52.947+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:52.992 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:52.985+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:53.026 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:53.018+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:53.130 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:53.120+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:53.336 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:44:53.329+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.357129+0000 front 2019-12-11T19:43:30.824793+0000 (oldest deadline 2019-12-11T19:44:15.422120+0000) 2019-12-11T19:44:53.543 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:44:53.533+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.559405+0000 front 2019-12-11T19:43:32.799177+0000 (oldest deadline 2019-12-11T19:44:17.051805+0000) 2019-12-11T19:44:53.614 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:44:53.604+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.970939+0000 front 2019-12-11T19:43:31.972320+0000 (oldest deadline 2019-12-11T19:44:52.999841+0000) 2019-12-11T19:44:53.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:44:53.967+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:30.824975+0000 front 2019-12-11T19:43:31.385463+0000 (oldest deadline 2019-12-11T19:44:15.511739+0000) 2019-12-11T19:44:54.030 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:44:54.020+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.051278+0000 front 2019-12-11T19:43:34.058691+0000 (oldest deadline 2019-12-11T19:44:17.523005+0000) 2019-12-11T19:44:54.032 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:44:54.024+0000 1694f700 -1 osd.0 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:32.857376+0000 front 2019-12-11T19:43:32.890051+0000 (oldest deadline 2019-12-11T19:44:17.543079+0000) 2019-12-11T19:44:54.161 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:44:54.152+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:34.877809+0000 front 2019-12-11T19:43:34.844516+0000 (oldest deadline 2019-12-11T19:44:19.286104+0000) 2019-12-11T19:44:54.205 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:44:54.196+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e312 v312) 2019-12-11T19:44:54.576 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:44:54.568+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:43:31.970939+0000 front 2019-12-11T19:43:31.972320+0000 (oldest deadline 2019-12-11T19:44:52.999841+0000) 2019-12-11T19:45:50.524 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:50.515+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:51.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:51.431+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:51.545 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:51.535+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:52.401 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:52.392+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:52.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:52.413+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:52.570 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:52.561+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:52.630 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:52.622+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:53.098 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:53.091+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:53.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:53.406+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:53.443 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:53.432+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:53.552 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:53.543+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:53.631 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:53.623+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:54.148 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:54.141+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:54.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:54.385+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:54.406 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:54.397+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:54.579 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:54.570+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:54.653 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:54.646+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:55.175 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:55.168+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:55.359 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:55.350+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:55.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:55.392+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:55.538 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:55.530+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:55.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:55.624+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:56.163 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:56.154+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:56.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:56.375+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:56.383 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:56.375+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:56.563 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:56.554+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:56.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:56.619+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:56.767 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:45:56.758+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:45:57.188 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:57.180+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:57.396 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:57.387+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:57.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:57.408+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:57.522 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:57.514+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:57.616 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:57.609+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:57.752 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:45:57.739+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:45:58.207 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:58.200+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:58.421 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:58.412+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:58.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:58.446+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:58.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:58.510+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:58.576 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:58.569+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:58.735 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:45:58.726+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:45:59.229 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:45:59.221+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:45:59.377 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:45:59.369+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:45:59.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:45:59.423+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:45:59.516 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:45:59.507+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:45:59.603 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:45:59.596+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:45:59.702 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:45:59.694+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:00.279 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:00.271+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:00.345 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:00.336+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:00.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:00.412+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:00.554 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:00.546+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:00.591 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:00.584+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:00.680 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:00.671+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:01.235 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:01.228+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:01.375 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:01.366+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:01.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:01.380+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:01.548 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:01.539+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:01.622 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:01.614+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:01.692 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:01.683+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:02.275 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:02.266+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:02.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:02.353+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:02.422 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:02.413+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:02.588 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:02.579+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:02.596 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:02.590+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:02.730 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:02.721+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:03.306 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:03.300+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:03.380 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:03.372+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:03.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:03.385+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:03.552 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:03.545+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:03.601 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:03.592+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:03.729 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:03.720+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:04.289 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:04.282+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:04.340 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:04.332+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:04.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:04.397+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:04.508 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:04.501+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:04.605 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:04.596+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:04.775 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:04.766+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:05.283 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:05.270+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:05.304 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:05.289+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:05.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:05.423+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:05.573 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:05.543+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:05.573 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:05.558+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:05.804 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:05.795+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:06.274 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:06.266+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:06.346 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:06.338+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:06.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:06.438+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:06.520 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:06.513+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:06.586 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:06.576+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:06.785 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:06.775+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:07.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:07.137+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:07.280 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:07.272+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:07.386 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:07.378+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:07.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:07.465+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:07.485 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:07.477+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:07.566 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:07.558+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:07.746 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:07.737+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:08.166 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:08.158+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:08.167 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:08.159+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:08.329 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:08.321+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:08.352 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:08.344+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:08.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:08.425+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:08.509 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:08.499+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:08.590 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:08.581+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:08.755 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:08.746+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:09.121 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:09.114+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:09.124 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:09.117+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:09.309 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:09.303+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:09.381 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:09.372+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:09.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:09.410+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:09.475 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:09.469+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:09.618 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:09.609+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:09.798 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:09.789+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:10.084 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:10.075+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:10.086 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:10.078+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:10.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:10.338+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:10.359 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:10.351+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:10.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:10.389+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:10.443 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:10.436+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:10.623 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:10.615+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:10.811 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:10.803+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:11.062 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:11.055+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:11.066 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:11.058+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:11.351 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:11.345+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:11.374 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:11.365+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:11.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:11.414+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:11.462 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:11.456+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:11.667 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:11.658+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:11.774 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:11.766+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:12.073 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:12.065+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:12.075 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:12.067+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:12.344 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:12.336+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:12.385 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:12.378+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:12.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:12.391+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:12.423 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:12.415+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:12.671 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:12.660+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:12.733 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:12.722+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:13.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:13.082+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:13.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:13.084+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:13.331 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:13.322+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:13.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:13.362+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:13.429 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:13.418+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:13.437 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:13.429+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:13.683 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:13.673+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:13.719 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:13.709+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:14.124 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:14.114+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:14.126 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:14.118+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:14.295 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:14.287+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:14.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:14.369+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:14.437 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:14.429+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:14.481 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:14.474+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:14.666 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:14.656+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:14.730 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:14.721+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:15.107 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:15.099+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:15.108 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:15.101+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:15.320 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:15.310+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:15.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:15.408+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:15.451 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:15.444+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:15.484 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:15.477+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:15.652 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:15.642+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:15.754 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:15.745+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:16.086 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:16.077+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:16.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:16.080+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:16.324 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:16.314+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:16.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:16.436+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:16.453 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:16.446+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:16.512 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:16.505+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:16.679 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:16.669+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:16.785 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:16.775+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:17.091 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:17.083+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:17.094 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:17.085+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:17.311 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:17.301+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:17.470 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:17.462+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:17.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:17.466+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:17.544 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:17.537+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:17.703 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:17.693+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:17.781 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:17.771+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:18.102 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:18.095+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:18.106 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:18.099+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:18.342 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:18.332+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:18.488 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:18.481+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:18.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:18.513+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:18.565 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:18.558+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:18.698 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:18.688+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:18.771 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:18.761+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:19.097 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:19.090+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:19.101 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:19.093+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:19.340 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:19.330+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:19.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:19.492+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:19.523 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:19.517+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:19.585 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:19.578+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:19.734 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:19.723+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:19.750 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:19.741+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:20.058 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:20.050+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:20.062 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:20.054+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:20.350 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:20.339+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:20.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:20.469+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:20.553 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:20.545+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:20.598 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:20.590+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:20.724 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:20.715+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:20.797 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:20.786+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:21.051 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:21.044+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:21.057 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:21.049+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:21.353 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:21.343+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:21.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:21.443+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:21.598 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:21.583+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:21.652 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:21.637+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:21.767 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:21.757+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:21.796 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:21.786+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:22.059 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:22.049+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:22.060 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:22.052+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:22.337 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:22.328+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:22.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:22.408+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:22.602 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:22.594+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:22.629 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:22.620+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:22.760 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:22.750+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:22.771 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:22.762+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:23.048 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:23.040+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:23.050 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:23.041+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:23.332 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:23.323+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:23.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:23.457+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:23.585 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:23.577+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:23.616 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:23.608+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:23.785 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:23.775+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:23.789 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:23.779+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:24.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:24.080+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:24.090 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:24.083+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:24.365 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:24.355+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:24.472 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:46:24.463+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 40sec e317 v317) 2019-12-11T19:46:24.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:24.506+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:24.584 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:24.577+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:24.664 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:24.657+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:24.765 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:24.755+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:24.780 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:24.770+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:25.084 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:25.077+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:25.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:25.080+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:25.342 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:25.332+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:25.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:25.466+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:25.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:25.628+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:25.648 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:25.641+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:25.764 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:25.753+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:25.777 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:25.769+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:26.096 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:26.087+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:26.097 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:26.090+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:26.364 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:26.355+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:26.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:26.421+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:26.642 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:26.635+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:26.689 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:26.682+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:26.752 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:26.744+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:26.756 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:26.748+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:27.092 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:27.085+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:27.094 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:27.088+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:27.338 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:27.330+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:27.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:27.431+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:27.633 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:27.625+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:27.732 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:27.724+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:27.798 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:27.791+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:27.802 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:27.794+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:28.153 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:28.143+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:28.155 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:28.148+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:28.362 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:28.353+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:28.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:28.445+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:28.643 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:28.637+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:28.766 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:28.755+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:28.778 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:28.771+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:28.830 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:28.821+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:29.153 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:29.147+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:29.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:29.150+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:29.368 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:29.360+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:29.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:29.417+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:29.489 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:46:29.481+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 40sec e317 v317) 2019-12-11T19:46:29.617 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:29.610+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:29.754 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:29.746+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:29.817 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:29.806+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:29.849 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:29.841+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:30.166 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:30.160+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:30.169 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:30.163+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:30.392 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:30.384+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:30.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:30.412+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:30.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:30.625+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:30.723 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:30.716+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:30.806 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:30.797+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:30.845 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:30.835+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:31.166 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:31.158+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:31.167 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:31.160+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:31.362 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:31.353+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:31.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:31.426+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:31.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:31.674+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:31.739 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:31.732+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:31.822 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:31.814+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:31.844 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:31.836+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:32.125 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:32.116+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:32.126 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:32.118+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:32.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:32.380+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:32.414 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:32.406+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:32.694 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:32.686+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:32.753 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:32.745+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:32.839 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:32.830+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:32.862 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:32.853+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:33.084 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:33.076+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:33.084 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:33.077+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:33.396 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:33.388+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:33.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:33.405+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:33.663 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:33.657+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:33.766 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:33.758+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:33.875 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:33.866+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:33.911 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:46:33.902+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:12.078330+0000 front 2019-12-11T19:45:10.889366+0000 (oldest deadline 2019-12-11T19:45:50.449891+0000) 2019-12-11T19:46:34.065 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:34.058+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:34.070 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:34.063+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:34.425 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:34.417+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:34.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:34.443+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:34.502 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:46:34.494+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 40sec e317 v317) 2019-12-11T19:46:34.709 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:34.701+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:34.747 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:34.741+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:34.858 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:34.850+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:35.108 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:35.101+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:35.112 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:35.105+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:35.474 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:35.464+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:35.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:35.476+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:35.738 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:35.731+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:35.765 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:35.757+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:35.884 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:35.875+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:36.117 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:36.109+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:36.118 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:36.110+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:36.438 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:36.429+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:36.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:36.512+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:36.761 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:36.755+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:36.814 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:36.807+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:36.839 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:36.831+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:37.164 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:37.155+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:37.165 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:37.157+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:37.475 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:37.467+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:37.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:37.542+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:37.753 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:37.746+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:37.803 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:37.792+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:37.860 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:37.851+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:38.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:38.143+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:38.152 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:38.144+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:38.506 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:38.497+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:38.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:38.546+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:38.756 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:46:38.749+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:06.583595+0000 front 2019-12-11T19:45:06.661952+0000 (oldest deadline 2019-12-11T19:45:51.795185+0000) 2019-12-11T19:46:38.814 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:38.807+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:46:38.851 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:46:38.843+0000 1694f700 -1 osd.6 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.595160+0000 front 2019-12-11T19:45:10.593833+0000 (oldest deadline 2019-12-11T19:45:55.924998+0000) 2019-12-11T19:46:39.155 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:39.143+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:45:27.202586+0000 (oldest deadline 2019-12-11T19:46:07.202586+0000) 2019-12-11T19:46:39.156 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:46:39.149+0000 1694f700 -1 osd.2 317 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e316) 2019-12-11T19:46:39.472 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:46:39.464+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:08.316384+0000 front 2019-12-11T19:45:08.224950+0000 (oldest deadline 2019-12-11T19:45:52.295362+0000) 2019-12-11T19:46:39.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:46:39.524+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:10.886135+0000 front 2019-12-11T19:45:09.648899+0000 (oldest deadline 2019-12-11T19:45:51.320980+0000) 2019-12-11T19:46:39.577 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:46:39.564+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 40sec e317 v317) 2019-12-11T19:46:39.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:46:39.794+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:45:09.735140+0000 front 2019-12-11T19:45:09.281749+0000 (oldest deadline 2019-12-11T19:45:52.555349+0000) 2019-12-11T19:47:30.162 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:05:30.378 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.170 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:05:30.386 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.178 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:05:30.394 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.181 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:05:30.398 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.197 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:05:30.370 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.205 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:05:30.378 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.404 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:05:30.620 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.451 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:05:30.625 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:47:30.510 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:05:30.726 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:48:16.183 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:16.174+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:16.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:16.700+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:16.960 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:16.950+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:17.202 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:17.192+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:17.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:17.723+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:17.945 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:17.933+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:18.194 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:18.183+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:18.225 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:18.218+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:18.677 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:18.667+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:18.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:18.766+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:18.858 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:18.848+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:18.987 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:18.978+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:19.153 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:19.144+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:19.197 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:19.190+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:19.695 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:19.684+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:19.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:19.781+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:19.836 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:19.828+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:19.920 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:19.909+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:20.030 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:20.021+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:20.177 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:20.170+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:20.194 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:20.185+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:20.669 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:20.654+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:20.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:20.828+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:20.850 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:20.841+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:20.950 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:20.942+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:20.992 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:20.983+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:21.149 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:21.143+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:21.207 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:21.198+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:21.654 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:21.644+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:21.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:21.826+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:21.904 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:21.894+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:21.984 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:21.977+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:22.021 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:22.012+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:22.149 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:22.142+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:22.166 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:22.156+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:22.627 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:22.618+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:22.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:22.824+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:22.940 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:22.930+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:22.988 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:22.981+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:23.038 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:23.028+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:23.131 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:23.123+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:23.164 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:23.155+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:23.585 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:23.575+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:23.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:23.783+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:23.973 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:23.964+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:23.986 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:23.978+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:24.056 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:24.039+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:24.098 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:24.091+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:24.153 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:24.145+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:24.625 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:24.616+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:24.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:24.778+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:24.973 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:24.965+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:25.027 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:25.017+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:25.064 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:25.054+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:25.107 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:25.097+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:25.169 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:25.159+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:25.678 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:25.669+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:25.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:25.748+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:26.020 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:26.013+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:26.036 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:26.027+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:26.048 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:26.039+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:26.152 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:26.145+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:26.180 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:26.171+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:26.725 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:26.715+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:26.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:26.791+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:26.995 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:26.985+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:27.011 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:27.004+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:27.042 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:27.032+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:27.181 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:27.175+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:27.228 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:27.219+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:27.728 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:27.718+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:27.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:27.830+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:28.007 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:28.000+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:28.016 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:28.007+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:28.044 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:28.035+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:28.146 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:28.138+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:28.247 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:28.237+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:28.738 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:28.728+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:28.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:28.883+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:29.018 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:29.010+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:29.061 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:29.051+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:29.071 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:29.062+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:29.136 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:29.128+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:29.247 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:29.237+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:29.735 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:29.725+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:29.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:29.915+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:30.048 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:30.040+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:30.096 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:30.089+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:30.108 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:30.097+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:30.108 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:30.098+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:30.270 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:30.260+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:30.775 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:30.765+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:30.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:30.904+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:31.013 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:31.004+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:31.058 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:31.050+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:31.084 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:31.074+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:31.123 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:31.113+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:31.283 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:31.273+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:31.781 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:31.771+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:31.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:31.939+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:32.011 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:32.002+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:32.029 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:32.020+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:32.093 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:32.084+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:32.111 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:32.101+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:32.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:32.325+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:32.809 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:32.799+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:32.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:32.910+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:32.978 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:32.970+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:33.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:32.999+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:33.090 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:33.080+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:33.106 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:33.097+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:33.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:33.325+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:33.782 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:33.772+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:33.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:33.939+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:33.970 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:33.962+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:34.015 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:34.007+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:34.055 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:34.045+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:34.102 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:34.090+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:34.364 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:34.354+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:34.819 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:34.809+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:34.933 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:34.926+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:34.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:34.949+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:35.033 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:35.026+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:35.063 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:35.054+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:35.154 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:35.144+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:35.394 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:35.384+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:35.793 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:35.783+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:35.894 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:35.888+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:35.987 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:35.980+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:35.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:35.982+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:36.101 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:36.092+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:36.185 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:36.176+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:36.428 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:36.418+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:36.822 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:36.811+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:36.924 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:36.917+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:36.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:36.972+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:37.016 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:37.008+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:37.128 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:37.118+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:37.150 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:37.140+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:37.454 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:37.444+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:37.851 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:37.841+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:37.902 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:37.894+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:38.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:37.993+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:38.058 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:38.047+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:38.148 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:38.137+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:38.203 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:38.190+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:38.494 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:38.484+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:38.844 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:38.834+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:38.882 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:38.874+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:39.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:39.021+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:39.104 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:39.096+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:39.150 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:39.139+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:39.237 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:39.226+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:39.542 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:39.532+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:39.820 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:39.810+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:39.845 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:39.837+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:40.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:40.017+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:40.144 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:40.136+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:40.177 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:40.168+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:40.247 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:40.236+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:40.569 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:40.555+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:40.809 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:40.801+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:40.859 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:40.848+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:41.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:41.039+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:41.144 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:41.137+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:41.178 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:41.168+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:41.256 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:41.245+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:41.582 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:41.571+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:41.838 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:41.830+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:41.903 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:41.881+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:42.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:42.040+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:42.133 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:42.122+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:42.173 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:42.165+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:42.217 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:42.206+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:42.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:42.600+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:42.833 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:42.826+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:42.867 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:42.855+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:43.091 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:43.081+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:43.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:43.088+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:43.184 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:43.173+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:43.212 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:43.204+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:43.637 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:43.627+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:43.856 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:43.848+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:43.900 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:43.889+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:44.064 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:44.053+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:44.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:44.111+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:44.193 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:44.182+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:44.228 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:44.221+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:44.664 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:44.653+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:44.895 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:44.887+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:44.906 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:44.896+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:45.046 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:45.036+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:45.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:45.128+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:45.179 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:45.168+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:45.259 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:45.252+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:45.710 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:45.700+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:45.873 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:45.861+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:45.929 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:45.921+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:46.056 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:46.045+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:46.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:46.105+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:46.189 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:46.178+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:46.212 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:46.205+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:46.715 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:46.703+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:46.876 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:46.865+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:46.889 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:46.881+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:47.080 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:47.070+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:47.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:47.134+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:47.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:47.193+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:47.222 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:47.212+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:47.669 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:47.658+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:47.855 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:47.844+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:47.895 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:47.888+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:48.063 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:48.052+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:48.170 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:48.163+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:48.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:48.164+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:48.269 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:48.259+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:48.666 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:48.655+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:48.885 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:48.875+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:48.912 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:48.902+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:49.071 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:49.062+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:49.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:49.153+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:49.205 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:49.198+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:49.238 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:49.228+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:49.716 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:49.705+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:49.908 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:49.899+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:49.921 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:48:49.914+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e323 v323) 2019-12-11T19:48:49.921 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:49.913+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:50.069 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:50.059+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:50.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:50.173+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:50.225 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:50.219+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:50.260 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:48:50.251+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.206435+0000 front 2019-12-11T19:47:35.204703+0000 (oldest deadline 2019-12-11T19:48:16.873507+0000) 2019-12-11T19:48:50.679 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:50.669+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:50.880 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:50.872+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:50.935 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:50.925+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:51.104 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:51.093+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:51.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:51.219+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:51.264 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:51.256+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:51.691 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:51.682+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:51.929 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:51.922+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:51.929 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:51.919+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:52.102 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:52.093+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:52.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:52.221+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:52.240 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:52.231+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:52.746 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:52.737+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:52.923 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:52.913+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:52.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:52.938+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:53.067 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:53.057+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:53.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:53.183+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:53.252 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:53.245+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:53.789 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:53.779+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:53.919 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:53.909+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:53.979 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:53.971+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:54.026 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:54.017+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:54.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:54.170+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:54.268 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:54.257+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:54.755 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:54.746+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:54.876 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:54.867+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:55.018 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:48:55.011+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e323 v323) 2019-12-11T19:48:55.019 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:55.012+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:55.046 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:55.037+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:55.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:55.161+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:55.248 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:55.240+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:55.775 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:55.766+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:55.874 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:55.864+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:56.029 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:56.023+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:56.051 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:56.042+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:56.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:56.144+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:56.227 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:56.219+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:56.765 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:56.754+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:56.937 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:56.927+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:57.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:57.019+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:57.043 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:57.036+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:57.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:57.121+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:57.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:57.194+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:57.784 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:57.774+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:57.940 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:57.930+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:58.021 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:58.014+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:58.077 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:58.066+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:58.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:58.109+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:58.254 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:58.246+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:58.768 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:58.759+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:58.960 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:58.950+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:48:59.059 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:48:59.051+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:48:59.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:48:59.070+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:48:59.126 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:48:59.117+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:48:59.310 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:48:59.301+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:48:59.727 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:48:59.716+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:48:59.923 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:48:59.913+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:00.035 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:00.028+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:00.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:00.031+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:00.059 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:49:00.053+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e323 v323) 2019-12-11T19:49:00.163 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:00.153+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:00.320 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:00.312+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:00.735 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:00.725+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:00.937 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:00.928+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:01.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:01.053+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:01.065 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:01.057+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:01.210 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:01.200+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:01.314 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:01.307+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:01.777 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:01.768+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:01.972 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:01.963+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:02.031 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:02.024+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:02.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:02.035+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:02.202 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:02.192+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:02.320 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:02.313+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:02.777 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:02.767+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:02.993 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:02.985+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:02.997 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:02.988+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:03.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:03.053+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:03.245 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:03.235+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:03.298 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:03.290+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:03.812 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:03.803+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:03.982 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:03.974+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:04.001 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:03.991+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:04.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:04.102+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:04.231 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:04.221+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:04.330 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:04.322+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:04.810 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:04.799+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:04.965 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:04.956+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:04.981 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:04.971+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:05.064 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:49:05.058+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 45sec e323 v323) 2019-12-11T19:49:05.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:05.099+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:05.278 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:05.268+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:05.338 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:05.331+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:05.868 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:05.853+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:05.958 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:05.947+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:06.011 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:06.001+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:06.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:06.087+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:06.262 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:06.252+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:06.297 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:06.289+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:06.878 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:06.868+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:06.921 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:06.913+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:07.013 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:07.003+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:07.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:07.083+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:07.252 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:07.245+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:07.315 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:07.305+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:07.899 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:07.889+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:07.919 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:07.912+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:07.991 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:07.981+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:08.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:08.095+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:08.216 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:08.208+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:08.298 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:08.288+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:49:08.894 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:49:08.884+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:31.342785+0000 front 2019-12-11T19:47:31.351800+0000 (oldest deadline 2019-12-11T19:48:16.034135+0000) 2019-12-11T19:49:08.948 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:49:08.942+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:35.576393+0000 front 2019-12-11T19:47:35.581111+0000 (oldest deadline 2019-12-11T19:48:17.799929+0000) 2019-12-11T19:49:09.039 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:49:09.030+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.023564+0000 front 2019-12-11T19:47:33.034186+0000 (oldest deadline 2019-12-11T19:48:18.280286+0000) 2019-12-11T19:49:09.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:49:09.082+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:34.242168+0000 front 2019-12-11T19:47:33.635055+0000 (oldest deadline 2019-12-11T19:48:16.431620+0000) 2019-12-11T19:49:09.171 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:49:09.162+0000 1694f700 -1 osd.0 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:33.245831+0000 front 2019-12-11T19:47:33.869995+0000 (oldest deadline 2019-12-11T19:48:19.140679+0000) 2019-12-11T19:49:09.321 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:49:09.311+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:47:32.091001+0000 front 2019-12-11T19:47:32.044174+0000 (oldest deadline 2019-12-11T19:48:17.875279+0000) 2019-12-11T19:50:05.359 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:05.352+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:05.978 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:05.968+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:06.273 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:06.263+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:06.384 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:06.378+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:06.971 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:06.961+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:07.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:07.314+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:07.357 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:07.350+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:07.387 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:07.378+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:08.022 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:08.013+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:08.362 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:08.355+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:08.372 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:08.363+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:08.393 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:08.384+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:09.019 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:09.009+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:09.326 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:09.318+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:09.403 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:09.394+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:09.442 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:09.432+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:09.982 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:09.973+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:10.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:10.199+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:10.302 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:10.291+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:10.389 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:10.383+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:10.416 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:10.407+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:10.978 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:10.969+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:11.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:11.166+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:11.286 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:11.277+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:11.346 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:11.338+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:11.450 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:11.442+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:12.023 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:12.015+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:12.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:12.131+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:12.236 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:12.228+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:12.308 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:12.299+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:12.360 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:12.353+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:12.433 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:12.423+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:13.029 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:13.019+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:13.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:13.093+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:13.209 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:13.203+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:13.321 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:13.312+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:13.380 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:13.373+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:13.442 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:13.432+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:14.069 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:14.059+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:14.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:14.094+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:14.205 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:14.197+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:14.309 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:14.299+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:14.369 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:14.363+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:14.492 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:14.483+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:15.114 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:15.105+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:15.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:15.123+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:15.177 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:15.170+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:15.326 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:15.319+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:15.354 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:15.345+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:15.484 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:15.475+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:16.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:16.087+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:16.119 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:16.110+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:16.233 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:16.138+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:16.313 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:16.306+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:16.356 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:16.346+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:16.523 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:16.513+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:17.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:17.058+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:17.127 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:17.116+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:17.127 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:17.119+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:17.320 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:17.313+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:17.405 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:17.393+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:17.555 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:17.544+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:18.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:18.015+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:18.160 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:18.151+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:18.180 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:18.171+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:18.182 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:18.174+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:18.274 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:18.267+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:18.421 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:18.411+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:18.528 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:18.519+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:19.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:19.057+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:19.180 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:19.170+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:19.186 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:19.179+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:19.186 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:19.180+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:19.264 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:19.256+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:19.400 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:19.390+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:19.529 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:19.519+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:20.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:20.063+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:20.171 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:20.162+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:20.172 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:20.164+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:20.181 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:20.171+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:20.251 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:20.244+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:20.362 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:20.352+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:20.484 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:20.474+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:21.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:21.036+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:21.139 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:21.130+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:21.141 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:21.132+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:21.200 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:21.190+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:21.223 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:21.216+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:21.335 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:21.325+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:21.534 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:21.523+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:22.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:22.003+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:22.191 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:22.179+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:22.192 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:22.182+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:22.195 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:22.187+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:22.235 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:22.226+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:22.354 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:22.345+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:22.497 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:22.484+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:23.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:23.035+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:23.224 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:23.217+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:23.225 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:23.216+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:23.228 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:23.218+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:23.229 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:23.222+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:23.407 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:23.397+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:23.452 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:23.442+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:24.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:24.056+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:24.228 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:24.220+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:24.252 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:24.246+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:24.256 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:24.249+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:24.279 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:24.270+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:24.413 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:24.403+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:24.479 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:24.469+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:25.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:25.050+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:25.229 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:25.223+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:25.277 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:25.269+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:25.278 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:25.271+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:25.291 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:25.282+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:25.455 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:25.447+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:25.464 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:25.456+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:26.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:26.060+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:26.231 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:26.223+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:26.245 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:26.237+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:26.246 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:26.238+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:26.333 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:26.324+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:26.433 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:26.425+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:26.449 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:26.441+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:27.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:27.040+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:27.284 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:27.277+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:27.285 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:27.279+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:27.288 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:27.282+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:27.323 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:27.314+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:27.442 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:27.434+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:27.466 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:27.458+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:28.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:28.065+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:28.291 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:28.282+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:28.318 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:28.312+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:28.319 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:28.311+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:28.321 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:28.315+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:28.447 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:28.438+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:28.474 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:28.467+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:29.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:29.107+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:29.302 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:29.294+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:29.339 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:29.333+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:29.359 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:29.351+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:29.360 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:29.352+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:29.497 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:29.489+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:29.509 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:29.502+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:30.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:30.138+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:30.264 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:30.256+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:30.298 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:30.292+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:30.349 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:30.341+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:30.351 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:30.342+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:30.470 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:30.462+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:30.518 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:30.510+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:31.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:31.120+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:31.253 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:31.245+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:31.305 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:31.299+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:31.333 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:31.324+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:31.333 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:31.326+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:31.432 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:31.423+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:31.511 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:31.503+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:32.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:32.093+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:32.300 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:32.291+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:32.333 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:32.323+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:32.334 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:32.326+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:32.356 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:32.349+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:32.416 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:32.408+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:32.468 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:32.460+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:33.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:33.066+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:33.317 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:33.308+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:33.340 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:33.333+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:33.345 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:33.338+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:33.401 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:33.394+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:33.474 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:33.462+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:33.476 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:33.467+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:34.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:34.114+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:34.275 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:34.266+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:34.337 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:34.330+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:34.337 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:34.331+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:34.381 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:34.373+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:34.440 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:34.433+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:34.481 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:34.472+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:34.522 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:34.513+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:35.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:35.083+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:35.245 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:35.237+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:35.383 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:35.373+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:35.384 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:35.377+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:35.398 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:35.392+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:35.424 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:35.417+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:35.521 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:35.512+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:35.545 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:35.537+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:36.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:36.053+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:36.219 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:36.211+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:36.396 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:36.387+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:36.398 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:36.389+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:36.423 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:36.416+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:36.433 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:36.427+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:36.524 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:36.515+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:36.527 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:36.517+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:37.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:37.037+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:37.250 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:37.241+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:37.427 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:37.420+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:37.431 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:37.424+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:37.432 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:37.425+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:37.475 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:37.468+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:37.564 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:37.555+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:37.570 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:37.562+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:38.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:37.993+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:38.273 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:38.264+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:38.388 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:38.382+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:38.390 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:38.384+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:38.391 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:38.385+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:38.513 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:38.506+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:38.569 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:38.560+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:38.571 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:38.563+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:38.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:38.975+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:39.315 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:39.307+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:39.367 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:39.358+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:39.368 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:39.360+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:39.379 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:39.371+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:39.526 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:39.517+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:39.557 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:39.549+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:39.609 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:39.601+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:39.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:39.973+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:40.329 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:40.320+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:40.356 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:40.348+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:40.404 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:40.394+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:40.405 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:40.396+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:40.420 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:50:40.411+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e329 v329) 2019-12-11T19:50:40.508 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:40.500+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:40.523 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:40.515+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:40.635 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:40.626+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:40.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:40.947+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:41.348 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:41.340+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:41.372 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:41.364+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:41.376 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:41.366+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:41.378 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:41.368+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:41.502 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:41.493+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:41.555 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:41.548+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:41.647 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:41.639+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:41.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:41.943+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:42.345 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:42.334+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:42.347 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:42.335+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:42.354 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:42.347+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:42.411 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:42.402+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:42.516 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:42.507+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:42.588 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:42.579+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:42.650 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:42.641+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:42.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:42.971+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:43.308 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:43.301+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:43.311 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:43.304+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:43.392 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:43.384+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:43.394 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:43.386+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:43.500 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:43.491+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:43.618 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:43.611+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:43.675 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:43.667+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:43.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:43.992+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:44.358 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:44.350+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:44.359 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:44.352+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:44.405 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:44.398+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:44.413 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:44.403+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:44.521 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:44.512+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:44.603 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:44.596+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:44.680 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:44.671+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:44.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:44.960+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:45.329 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:45.319+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:45.329 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:45.320+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:45.421 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:45.413+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:45.442 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:50:45.434+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e329 v329) 2019-12-11T19:50:45.458 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:45.450+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:45.521 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:45.513+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:45.601 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:45.594+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:45.657 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:45.649+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:45.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:45.992+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:46.380 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:46.372+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:46.381 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:46.374+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:46.426 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:46.417+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:46.470 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:46.462+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:46.545 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:46.536+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:46.571 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:46.563+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:46.643 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:46.633+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:47.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:47.000+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:47.396 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:47.387+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:47.416 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:47.409+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:47.419 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:47.412+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:47.515 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:47.508+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:47.589 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:47.581+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:47.610 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:47.602+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:47.653 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:47.644+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:48.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:48.045+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:48.441 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:48.423+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:48.449 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:48.442+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:48.450 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:48.444+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:48.509 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:48.501+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:48.635 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:48.625+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:48.649 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:48.640+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:48.656 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:48.648+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:49.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:49.071+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:49.410 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:49.402+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:49.411 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:49.404+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:49.461 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:49.452+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:49.532 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:49.524+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:49.650 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:49.642+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:49.652 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:49.643+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:49.695 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:49.686+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:50.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:50.042+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:50.380 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:50.371+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:50.381 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:50.374+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:50.455 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:50:50.448+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e329 v329) 2019-12-11T19:50:50.468 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:50.460+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:50.494 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:50.487+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:50.639 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:50.631+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:50.648 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:50.640+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:50.680 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:50.674+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:51.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:51.026+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:51.383 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:51.376+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:51.386 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:51.379+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:51.503 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:51.496+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:51.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:51.502+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:51.615 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:51.606+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:51.667 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:51.658+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:51.673 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:51.667+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:52.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:52.048+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:52.373 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:52.365+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:52.374 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:52.367+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:52.473 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:52.462+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:52.498 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:52.482+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:52.660 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:52.646+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:52.700 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:52.688+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:52.702 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:52.689+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:53.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:53.032+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:53.344 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:53.334+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:53.345 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:53.337+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:53.442 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:53.435+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:53.509 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:53.501+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:53.658 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:53.648+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:53.675 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:53.668+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:53.705 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:53.696+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:53.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:53.990+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:54.384 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:54.377+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:54.388 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:54.381+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:54.398 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:54.392+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:54.510 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:54.501+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:54.616 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:54.607+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:54.657 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:54.649+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:50:54.724 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:50:54.716+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:26.181523+0000 front 2019-12-11T19:49:26.188443+0000 (oldest deadline 2019-12-11T19:50:06.161555+0000) 2019-12-11T19:50:54.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:50:54.984+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.485909+0000 front 2019-12-11T19:49:24.588003+0000 (oldest deadline 2019-12-11T19:50:09.919593+0000) 2019-12-11T19:50:55.358 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:55.349+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:49:37.309442+0000 (oldest deadline 2019-12-11T19:50:17.309442+0000) 2019-12-11T19:50:55.360 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:50:55.352+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e328) 2019-12-11T19:50:55.382 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:50:55.375+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:25.967091+0000 front 2019-12-11T19:49:23.138043+0000 (oldest deadline 2019-12-11T19:50:05.179522+0000) 2019-12-11T19:50:55.469 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:50:55.461+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:24.538075+0000 front 2019-12-11T19:49:26.124688+0000 (oldest deadline 2019-12-11T19:50:05.910129+0000) 2019-12-11T19:50:55.525 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:50:55.515+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 42sec e329 v329) 2019-12-11T19:50:55.606 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:50:55.586+0000 1694f700 -1 osd.5 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:23.118247+0000 front 2019-12-11T19:49:24.496758+0000 (oldest deadline 2019-12-11T19:50:07.196454+0000) 2019-12-11T19:50:55.635 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:50:55.627+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:49:21.170245+0000 front 2019-12-11T19:49:21.121882+0000 (oldest deadline 2019-12-11T19:50:33.779505+0000) 2019-12-11T19:51:05.707 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:05.924 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.752 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:05.968 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.753 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:05.970 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.762 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:05.978 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.796 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:05.969 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.800 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:05.973 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.904 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:06.120 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:05.964 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:06.180 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:06.051 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:06.225 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.922 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:41.138 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.927 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:41.144 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.936 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:41.152 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.941 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:41.157 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.949 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:41.122 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.959 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:41.132 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.993 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:09:41.209 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:40.994 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:09:41.210 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:51:41.076 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:09:41.249 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:52:29.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:29.841+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:30.247 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:30.237+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:30.545 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:30.536+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:30.802 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:30.795+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:31.205 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:31.195+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:31.549 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:31.541+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:31.642 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:31.632+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:31.828 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:31.820+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:32.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:32.175+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:32.429 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:32.420+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:32.486 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:32.476+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:32.577 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:32.570+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:32.600 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:32.590+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:32.825 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:32.817+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:33.243 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:33.232+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:33.392 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:33.383+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:33.473 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:33.464+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:33.597 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:33.589+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:33.607 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:33.597+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:33.798 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:33.790+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:34.274 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:34.260+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:34.386 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:34.376+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:34.445 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:34.435+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:34.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:34.473+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:34.637 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:34.629+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:34.656 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:34.646+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:34.844 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:34.835+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:35.275 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:35.266+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:35.385 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:35.376+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:35.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:35.429+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:35.473 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:35.464+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:35.643 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:35.633+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:35.653 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:35.644+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:35.859 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:35.852+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:36.302 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:36.293+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:36.434 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:36.424+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:36.465 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:36.455+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:36.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:36.477+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:36.606 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:36.596+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:36.651 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:36.644+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:36.904 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:36.896+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:37.313 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:37.304+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:37.413 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:37.404+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:37.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:37.482+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:37.519 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:37.511+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:37.654 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:37.646+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:37.658 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:37.649+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:37.913 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:37.906+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:38.344 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:38.334+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:38.395 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:38.387+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:38.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:38.461+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:38.483 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:38.473+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:38.620 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:38.612+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:38.640 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:38.633+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:38.924 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:38.915+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:39.335 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:39.325+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:39.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:39.425+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:39.433 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:39.424+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:39.514 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:39.504+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:39.595 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:39.588+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:39.637 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:39.627+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:39.968 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:39.960+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:40.373 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:40.362+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:40.446 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:40.426+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:40.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:40.450+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:40.483 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:40.473+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:40.561 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:40.554+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:40.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:40.650+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:40.998 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:40.990+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:41.393 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:41.382+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:41.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:41.444+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:41.454 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:41.443+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:41.509 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:41.498+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:41.587 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:41.579+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:41.694 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:41.679+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:42.020 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:42.012+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:42.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:42.438+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:42.446 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:42.435+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:42.499 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:42.488+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:42.529 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:42.519+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:42.554 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:42.546+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:42.662 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:42.652+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:43.022 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:43.014+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:43.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:43.392+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:43.472 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:43.461+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:43.475 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:43.464+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:43.533 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:43.525+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:43.557 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:43.546+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:43.679 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:43.667+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:44.076 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:44.069+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:44.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:44.399+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:44.520 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:44.509+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:44.522 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:44.511+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:44.535 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:44.528+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:44.564 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:44.553+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:44.706 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:44.694+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:45.126 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:45.119+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:45.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:45.387+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:45.506 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:45.500+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:45.550 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:45.539+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:45.551 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:45.541+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:45.562 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:45.551+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:45.759 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:45.748+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:46.160 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:46.152+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:46.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:46.398+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:46.506 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:46.495+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:46.507 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:46.499+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:46.607 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:46.597+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:46.609 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:46.597+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:46.740 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:46.730+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:47.130 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:47.122+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:47.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:47.353+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:47.499 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:47.492+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:47.545 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:47.534+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:47.606 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:47.595+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:47.636 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:47.623+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:47.745 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:47.736+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:48.144 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:48.136+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:48.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:48.314+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:48.532 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:48.524+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:48.553 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:48.542+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:48.583 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:48.572+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:48.600 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:48.589+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:48.725 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:48.714+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:49.155 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:49.147+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:49.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:49.289+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:49.521 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:49.514+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:49.526 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:49.515+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:49.605 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:49.594+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:49.611 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:49.601+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:49.764 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:49.753+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:50.129 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:50.121+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:50.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:50.280+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:50.484 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:50.475+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:50.537 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:50.526+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:50.579 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:50.568+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:50.600 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:50.590+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:50.782 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:50.771+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:51.137 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:51.128+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:51.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:51.244+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:51.481 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:51.472+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:51.519 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:51.508+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:51.597 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:51.586+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:51.608 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:51.598+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:51.785 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:51.775+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:52.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:52.092+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:52.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:52.233+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:52.490 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:52.480+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:52.519 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:52.511+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:52.613 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:52.603+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:52.627 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:52.616+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:52.772 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:52.761+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:53.078 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:53.071+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:53.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:53.255+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:53.453 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:53.442+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:53.568 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:53.560+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:53.619 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:53.609+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:53.673 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:53.663+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:53.755 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:53.745+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:54.078 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:54.067+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:54.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:54.230+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:54.493 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:54.483+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:54.580 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:54.569+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:54.609 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:54.602+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:54.639 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:54.628+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:54.745 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:54.734+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:55.036 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:55.027+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:55.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:55.266+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:55.526 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:55.517+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:55.559 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:55.549+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:55.642 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:55.635+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:55.642 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:55.632+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:55.750 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:55.740+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:56.089 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:56.082+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:56.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:56.270+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:56.546 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:56.537+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:56.550 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:56.541+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:56.669 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:56.659+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:56.678 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:56.670+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:56.753 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:56.744+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:57.117 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:57.109+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:57.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:57.246+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:57.573 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:57.563+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:57.595 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:57.585+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:57.630 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:57.620+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:57.643 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:57.636+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:57.753 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:57.743+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:58.125 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:58.118+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:58.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:58.255+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:58.571 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:58.561+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:58.592 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:58.583+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:58.660 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:58.651+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:58.666 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:58.656+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:58.753 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:58.743+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:52:59.153 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:52:59.146+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:52:59.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:52:59.288+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:52:59.551 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:52:59.541+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:52:59.556 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:52:59.546+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:52:59.698 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:52:59.689+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:52:59.708 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:52:59.700+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:52:59.745 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:52:59.735+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:00.130 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:00.123+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:00.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:00.318+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:00.555 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:00.546+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:00.561 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:00.552+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:00.697 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:00.687+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:00.710 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:00.704+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:00.752 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:00.742+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:01.015 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:53:01.009+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e334 v334) 2019-12-11T19:53:01.126 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:01.119+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:01.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:01.362+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:01.560 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:01.550+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:01.589 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:01.580+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:01.713 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:01.704+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:01.717 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:01.707+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:01.749 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:01.741+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:02.099 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:02.091+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:02.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:02.365+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:02.564 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:02.554+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:02.600 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:02.591+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:02.692 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:02.682+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:02.721 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:02.711+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:02.760 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:02.751+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:03.148 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:03.140+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:03.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:03.370+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:03.531 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:03.522+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:03.644 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:03.634+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:03.738 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:03.728+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:03.774 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:03.764+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:03.794 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:03.785+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:04.163 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:04.155+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:04.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:04.350+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:04.527 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:04.518+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:04.683 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:04.672+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:04.707 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:04.697+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:04.757 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:04.750+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:04.779 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:04.769+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:05.214 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:05.207+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:05.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:05.371+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:05.518 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:05.508+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:05.697 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:05.687+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:05.706 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:05.696+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:05.754 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:05.747+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:05.795 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:05.785+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:06.032 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:53:06.025+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e334 v334) 2019-12-11T19:53:06.243 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:06.236+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:06.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:06.406+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:06.509 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:06.501+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:06.726 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:06.713+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:06.737 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:06.728+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:06.769 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:06.762+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:06.795 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:06.785+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:07.209 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:07.202+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:07.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:07.363+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:07.549 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:07.540+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:07.724 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:07.715+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:07.740 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:07.730+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:07.786 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:07.778+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:07.838 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:07.829+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:08.180 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:08.171+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:08.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:08.399+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:08.524 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:08.515+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:08.699 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:08.689+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:08.745 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:08.735+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:08.799 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:08.790+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:08.866 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:08.856+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:09.178 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:09.170+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:09.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:09.398+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:09.505 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:09.495+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:09.726 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:09.716+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:09.755 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:09.746+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:09.810 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:09.801+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:09.881 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:09.871+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:10.225 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:10.217+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:10.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:10.386+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:10.526 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:53:10.518+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:44.364942+0000 front 2019-12-11T19:51:44.160582+0000 (oldest deadline 2019-12-11T19:52:29.345395+0000) 2019-12-11T19:53:10.719 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:53:10.710+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.053762+0000 front 2019-12-11T19:51:48.201820+0000 (oldest deadline 2019-12-11T19:52:32.078839+0000) 2019-12-11T19:53:10.753 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:53:10.743+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:46.991703+0000 front 2019-12-11T19:51:46.998441+0000 (oldest deadline 2019-12-11T19:52:31.665042+0000) 2019-12-11T19:53:10.799 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:53:10.792+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:48.560515+0000 front 2019-12-11T19:51:48.554353+0000 (oldest deadline 2019-12-11T19:52:30.242437+0000) 2019-12-11T19:53:10.848 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:53:10.838+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.434285+0000 front 2019-12-11T19:51:45.646322+0000 (oldest deadline 2019-12-11T19:52:30.713964+0000) 2019-12-11T19:53:11.089 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:53:11.077+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 41sec e334 v334) 2019-12-11T19:53:11.209 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:53:11.199+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:45.371632+0000 front 2019-12-11T19:51:45.372782+0000 (oldest deadline 2019-12-11T19:52:29.261832+0000) 2019-12-11T19:53:11.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:53:11.399+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:51:47.674959+0000 front 2019-12-11T19:51:47.675611+0000 (oldest deadline 2019-12-11T19:52:33.547793+0000) 2019-12-11T19:53:31.500 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:11:31.716 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.526 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:11:31.742 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.585 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:11:31.758 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.585 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:11:31.801 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.589 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:11:31.806 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.598 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:11:31.768 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.672 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:11:31.888 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.728 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:11:31.901 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:53:31.740 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:11:31.957 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:54:02.987 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:02.981+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:03.965 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:03.957+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:04.997 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:04.990+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:06.016 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:06.008+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:06.988 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:06.979+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:07.972 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:07.963+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:08.954 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:08.946+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:09.914 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:09.906+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:09.914 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:09.907+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:09.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:09.945+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:10.930 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:10.922+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:10.931 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:10.924+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:10.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:10.952+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:10.983 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:10.975+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:11.097 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:11.088+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:11.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:11.916+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:11.940 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:11.931+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:11.944 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:11.937+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:11.977 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:11.970+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:12.138 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:12.129+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:12.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:12.903+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:12.933 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:12.926+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:12.936 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:12.929+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:12.984 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:12.978+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:13.030 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:13.020+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:13.187 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:13.178+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:13.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:13.875+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:13.971 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:13.962+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:13.982 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:13.975+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:13.985 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:13.978+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:13.998 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:13.989+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:14.206 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:14.198+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:14.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:14.794+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:14.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:14.856+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:14.996 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:14.988+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:15.009 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:14.999+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:15.009 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:15.001+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:15.011 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:15.002+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:15.046 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:15.037+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:15.212 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:15.204+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:15.842 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:15.834+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:15.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:15.843+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:15.961 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:15.953+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:16.032 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:16.022+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:16.032 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:16.024+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:16.042 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:16.034+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:16.093 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:16.084+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:16.250 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:16.241+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:16.809 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:16.801+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:16.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:16.813+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:16.972 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:16.964+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:17.004 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:16.994+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:17.005 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:16.996+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:17.012 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:17.003+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:17.102 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:17.094+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:17.216 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:17.206+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:17.831 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:17.822+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:17.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:17.846+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:17.957 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:17.950+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:17.961 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:17.953+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:17.970 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:17.959+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:18.055 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:18.045+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:18.091 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:18.082+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:18.234 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:18.225+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:18.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:18.830+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:18.852 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:18.845+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:18.935 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:18.928+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:18.939 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:18.932+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:18.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:18.955+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:19.043 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:19.035+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:19.106 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:19.097+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:19.276 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:19.268+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:19.828 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:19.820+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:19.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:19.858+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:19.962 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:19.955+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:19.992 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:19.983+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:19.993 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:19.986+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:20.049 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:20.040+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:20.107 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:20.098+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:20.266 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:20.257+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:20.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:20.856+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:20.866 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:20.859+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:20.966 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:20.958+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:20.986 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:20.976+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:20.987 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:20.979+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:21.066 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:21.057+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:21.107 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:21.097+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:21.298 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:21.288+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:21.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:21.834+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:21.853 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:21.844+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:21.958 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:21.949+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:21.959 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:21.951+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:21.987 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:21.979+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:22.067 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:22.058+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:22.096 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:22.086+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:22.277 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:22.267+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:22.817 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:22.809+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:22.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:22.864+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:22.941 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:22.933+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:22.991 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:22.981+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:22.992 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:22.983+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:23.110 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:23.100+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:23.117 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:23.106+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:23.259 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:23.249+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:23.826 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:23.819+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:23.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:23.887+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:23.986 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:23.977+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:23.987 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:23.979+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:23.989 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:23.982+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:24.093 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:24.083+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:24.141 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:24.132+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:24.280 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:24.270+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:24.812 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:24.804+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:24.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:24.938+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:24.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:24.939+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:24.947 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:24.939+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:24.948 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:24.941+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:25.087 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:25.078+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:25.127 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:25.118+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:25.311 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:25.301+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:25.771 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:25.764+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:25.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:25.895+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:25.911 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:25.904+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:25.978 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:25.970+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:25.979 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:25.971+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:26.053 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:26.043+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:26.096 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:26.087+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:26.328 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:26.318+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:26.813 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:26.806+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:26.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:26.875+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:26.957 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:26.951+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:26.979 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:26.972+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:26.983 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:26.976+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:27.068 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:27.058+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:27.091 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:27.081+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:27.348 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:27.338+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:27.837 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:27.829+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:27.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:27.869+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:27.915 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:27.908+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:27.947 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:27.940+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:27.951 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:27.944+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:28.118 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:28.107+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:28.121 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:28.107+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:28.351 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:28.341+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:28.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:28.860+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:28.871 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:28.863+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:28.945 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:28.937+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:28.948 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:28.939+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:28.949 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:28.941+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:29.101 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:29.092+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:29.124 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:29.115+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:29.309 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:29.300+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:29.837 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:29.828+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:29.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:29.872+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:29.905 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:29.898+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:29.911 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:29.904+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:29.912 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:29.905+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:30.079 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:30.069+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:30.098 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:30.088+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:30.324 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:30.314+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:30.802 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:30.793+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:30.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:30.926+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:30.944 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:30.936+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:30.946 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:30.938+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:30.947 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:30.940+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:31.066 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:31.057+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:31.109 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:31.099+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:31.335 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:31.326+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:31.764 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:31.756+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:31.903 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:31.897+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:31.931 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:31.924+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:31.932 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:31.925+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:31.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:31.954+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:32.094 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:32.085+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:32.117 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:32.107+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:32.302 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:32.292+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:32.755 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:32.748+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:32.877 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:32.869+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:32.931 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:32.922+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:32.932 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:32.924+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:32.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:32.991+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:33.062 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:33.052+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:33.161 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:33.152+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:33.280 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:33.270+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:33.784 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:33.776+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:33.870 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:33.864+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:33.952 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:33.943+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:33.954 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:33.945+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:33.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:33.964+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:34.059 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:34.049+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:34.118 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:34.109+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:34.279 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:34.270+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:34.776 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:34.768+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:34.827 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:34.820+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:34.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:34.947+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:34.966 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:34.958+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:34.970 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:34.963+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:35.019 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:35.011+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:35.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:35.158+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:35.258 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:35.250+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:35.828 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:35.821+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:35.865 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:35.858+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:35.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:35.906+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:35.949 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:35.942+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:35.953 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:35.946+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:36.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:36.022+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:36.141 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:36.132+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:36.239 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:36.230+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:36.802 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:36.795+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:36.915 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:36.908+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:36.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:36.943+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:36.965 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:36.958+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:36.968 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:36.960+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:37.031 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:37.023+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:37.131 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:37.122+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:37.201 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:37.192+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:37.785 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:37.775+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:37.891 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:37.884+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:37.944 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:37.937+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:37.947 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:37.940+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:37.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:37.990+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:38.001 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:37.992+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:38.091 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:38.083+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:38.184 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:38.175+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:38.818 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:38.811+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:38.931 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:38.923+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:38.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:38.950+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:39.001 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:38.992+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:39.002 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:38.995+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:39.028 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:39.017+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:39.099 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:39.090+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:39.145 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:39.136+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:39.836 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:39.829+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:39.886 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:39.878+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:39.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:39.922+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:39.990 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:39.981+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:40.024 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:40.015+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:40.025 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:40.017+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:40.104 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:40.095+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:40.166 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:40.157+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:40.876 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:40.869+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:40.915 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:40.908+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:40.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:40.923+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:41.006 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:40.997+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:41.018 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:41.009+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:41.020 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:41.011+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:41.120 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:41.111+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:41.140 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:41.131+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:41.649 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:54:41.636+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e340 v340) 2019-12-11T19:54:41.909 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:41.901+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:41.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:41.928+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:41.952 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:41.943+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:41.979 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:41.971+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:41.980 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:41.973+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:42.007 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:41.998+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:42.104 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:42.095+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:42.145 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:42.136+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:42.905 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:42.898+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:42.950 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:42.940+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:42.951 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:42.943+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:42.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:42.978+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:42.986 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:42.978+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:43.016 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:43.006+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:43.072 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:43.064+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:43.117 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:43.109+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:43.904 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:43.897+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:43.921 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:43.912+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:43.921 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:43.914+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:43.993 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:43.981+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:44.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:44.021+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:44.029 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:44.017+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:44.093 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:44.085+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:44.097 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:44.089+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:44.919 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:44.912+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:44.952 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:44.944+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:44.953 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:44.946+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:44.984 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:44.976+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:45.027 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:45.018+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:45.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:45.062+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:45.085 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:45.070+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:45.085 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:45.073+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:45.915 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:45.906+0000 1694f700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.923506+0000 front 2019-12-11T19:53:28.744179+0000 (oldest deadline 2019-12-11T19:54:09.614745+0000) 2019-12-11T19:54:45.916 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:54:45.908+0000 1694f700 -1 osd.2 340 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4349.0:105758 7.8 7.c2da4bc8 (undecoded) ondisk+retry+write+known_if_redirected e338) 2019-12-11T19:54:45.939 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:54:45.932+0000 1694f700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.982995+0000 front 2019-12-11T19:53:29.082022+0000 (oldest deadline 2019-12-11T19:54:14.256931+0000) 2019-12-11T19:54:46.036 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:54:46.028+0000 1694f700 -1 osd.3 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.807691+0000 front 2019-12-11T19:53:28.731488+0000 (oldest deadline 2019-12-11T19:54:10.153906+0000) 2019-12-11T19:54:46.063 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:54:46.055+0000 1694f700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.656502+0000 front 2019-12-11T19:53:28.445236+0000 (oldest deadline 2019-12-11T19:54:14.282271+0000) 2019-12-11T19:54:46.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:46.058+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:54:46.074 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:54:46.066+0000 1694f700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:26.264859+0000 front 2019-12-11T19:53:26.248120+0000 (oldest deadline 2019-12-11T19:54:10.170380+0000) 2019-12-11T19:54:46.107 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:54:46.099+0000 1694f700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:28.581430+0000 front 2019-12-11T19:53:28.523739+0000 (oldest deadline 2019-12-11T19:54:12.673994+0000) 2019-12-11T19:54:46.694 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:54:46.684+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 44sec e340 v340) 2019-12-11T19:54:47.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:54:47.085+0000 1694f700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:53:27.806259+0000 front 2019-12-11T19:53:27.955828+0000 (oldest deadline 2019-12-11T19:54:09.459720+0000) 2019-12-11T19:55:31.369 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:55:31.299+0000 124b0700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-12-11T19:55:31.803 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:55:31.793+0000 11caf700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-12-11T19:55:31.807 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:55:31.799+0000 11caf700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-12-11T19:55:31.813 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:55:31.803+0000 114ae700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-12-11T19:55:41.395 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:13:41.611 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.408 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:13:41.624 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.410 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:13:41.626 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.415 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:13:41.631 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.424 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:13:41.597 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.435 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:13:41.608 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.553 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:13:41.769 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.578 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:13:41.794 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:55:41.616 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:13:41.789 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:56:33.715 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:33.705+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:33.890 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:33.881+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:34.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:34.597+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:34.667 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:34.660+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:34.712 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:34.701+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:34.733 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:34.724+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:34.850 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:34.840+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:34.960 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:34.953+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:35.003 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:34.993+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:35.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:35.562+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:35.678 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:35.670+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:35.711 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:35.702+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:35.754 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:35.744+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:35.819 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:35.809+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:36.010 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:36.000+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:36.010 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:36.003+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:36.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:36.577+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:36.674 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:36.666+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:36.712 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:36.703+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:36.740 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:36.732+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:36.780 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:36.770+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:37.031 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:37.017+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:37.061 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:37.054+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:37.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:37.578+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:37.666 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:37.658+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:37.683 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:37.672+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:37.795 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:37.785+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:37.811 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:37.801+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:38.023 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:38.016+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:38.039 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:38.029+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:38.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:38.565+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:38.657 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:38.647+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:38.674 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:38.664+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:38.760 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:38.751+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:38.840 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:38.830+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:39.011 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:39.003+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:39.065 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:39.055+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:39.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:39.530+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:39.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:39.648+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:39.723 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:39.714+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:39.763 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:39.754+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:39.869 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:39.860+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:40.028 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:40.021+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:40.030 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:40.021+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:40.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:40.490+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:40.681 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:40.673+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:40.722 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:40.712+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:40.778 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:40.768+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:40.889 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:40.880+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:40.998 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:40.991+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:41.001 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:40.992+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:41.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:41.450+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:41.697 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:41.687+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:41.734 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:41.723+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:41.775 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:41.765+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:41.911 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:41.901+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:41.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:41.955+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:42.005 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:41.996+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:42.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:42.405+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:42.701 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:42.691+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:42.712 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:42.704+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:42.773 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:42.764+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:42.870 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:42.860+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:42.955 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:42.948+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:43.046 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:43.037+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:43.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:43.450+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:43.684 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:43.678+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:43.694 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:43.685+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:43.812 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:43.802+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:43.852 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:43.842+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:44.007 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:44.000+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:44.064 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:44.055+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:44.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:44.436+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:44.637 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:44.630+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:44.712 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:44.703+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:44.848 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:44.838+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:44.902 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:44.893+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:44.994 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:44.986+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:45.057 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:45.048+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:45.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:45.406+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:45.595 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:45.587+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:45.678 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:45.668+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:45.870 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:45.856+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:45.883 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:45.871+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:45.949 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:45.941+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:46.059 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:46.050+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:46.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:46.443+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:46.567 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:46.560+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:46.728 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:46.718+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:46.885 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:46.875+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:46.897 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:46.888+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:46.954 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:46.946+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:47.061 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:47.050+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:47.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:47.425+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:47.589 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:47.581+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:47.698 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:47.688+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:47.851 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:47.841+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:47.865 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:47.855+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:47.942 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:47.935+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:48.023 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:48.013+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:48.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:48.439+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:48.629 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:48.621+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:48.668 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:48.658+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:48.861 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:48.852+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:48.881 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:48.869+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:48.903 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:48.896+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:49.016 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:49.006+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:49.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:49.491+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:49.646 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:49.639+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:49.654 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:49.644+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:49.876 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:49.867+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:49.893 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:49.885+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:49.942 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:49.934+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:49.995 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:49.985+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:50.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:50.540+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:50.667 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:50.659+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:50.695 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:50.685+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:50.886 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:50.876+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:50.943 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:50.936+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:50.946 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:50.937+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:51.022 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:51.013+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:51.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:51.583+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:51.684 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:51.674+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:51.694 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:51.686+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:51.858 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:51.846+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:51.915 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:51.907+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:51.939 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:51.929+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:51.994 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:51.984+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:52.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:52.578+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:52.707 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:52.699+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:52.741 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:52.731+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:52.846 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:52.834+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:52.877 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:52.863+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:52.963 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:52.953+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:53.009 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:52.999+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:53.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:53.619+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:53.701 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:53.690+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:53.728 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:53.721+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:53.841 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:53.831+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:53.894 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:53.887+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:53.973 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:53.962+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:54.000 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:53.989+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:54.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:54.592+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:54.684 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:54.674+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:54.777 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:54.770+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:54.837 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:54.827+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:54.883 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:54.876+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:54.941 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:54.930+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:54.972 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:54.961+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:55.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:55.575+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:55.707 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:55.694+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:55.775 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:55.767+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:55.849 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:55.838+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:55.878 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:55.871+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:55.953 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:55.937+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:55.974 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:55.964+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:56.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:56.533+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:56.711 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:56.700+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:56.756 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:56.748+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:56.858 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:56.851+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:56.867 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:56.855+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:56.975 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:56.964+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:56.998 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:56.988+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:57.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:57.517+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:57.668 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:57.658+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:57.751 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:57.743+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:57.830 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:57.822+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:57.869 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:57.859+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:57.998 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:57.987+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:57.999 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:57.988+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:58.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:58.506+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:58.706 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:58.696+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:58.769 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:58.761+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:58.828 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:58.820+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:58.861 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:58.851+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:58.985 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:56:58.974+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:56:58.987 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:58.977+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:56:59.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:56:59.546+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:56:59.747 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:56:59.736+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:56:59.770 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:56:59.763+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:56:59.794 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:56:59.787+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:56:59.884 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:56:59.873+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:56:59.965 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:56:59.955+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:00.038 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:00.027+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:00.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:00.547+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:00.740 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:00.729+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:00.817 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:00.809+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:00.847 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:00.840+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:00.907 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:00.896+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:00.979 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:00.967+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:01.090 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:01.079+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:01.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:01.512+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:01.760 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:01.750+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:01.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:01.840+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:01.873 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:01.865+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:01.879 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:01.868+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:02.011 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:02.000+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:02.117 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:02.107+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:02.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:02.488+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:02.758 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:02.748+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:02.850 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:02.838+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:02.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:02.871+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:02.924 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:02.915+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:03.034 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:03.023+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:03.139 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:03.125+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:03.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:03.477+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:03.787 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:03.775+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:03.861 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:03.852+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:03.869 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:03.858+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:03.933 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:03.925+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:04.047 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:04.037+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:04.121 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:04.110+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:04.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:04.503+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:04.746 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:04.736+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:04.819 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:04.810+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:04.824 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:04.815+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:04.982 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:04.974+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:05.086 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:05.076+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:05.148 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:05.139+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:05.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:05.456+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:05.768 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:05.758+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:05.826 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:05.819+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:05.847 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:05.837+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:05.997 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:05.990+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:06.068 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:06.058+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:06.107 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:06.097+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:06.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:06.463+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:06.771 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:06.762+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:06.809 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:06.799+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:06.827 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:06.819+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:07.050 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:07.042+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:07.064 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:57:07.057+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 42sec e346 v346) 2019-12-11T19:57:07.096 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:07.087+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:07.128 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:07.119+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:07.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:07.448+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:07.764 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:07.754+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:07.790 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:07.781+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:07.834 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:07.825+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:08.029 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:08.020+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:08.059 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:08.049+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:08.129 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:08.119+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:08.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:08.443+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:08.722 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:08.713+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:08.816 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:08.806+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:08.855 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:08.847+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:09.046 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:09.038+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:09.051 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:09.042+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:09.154 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:09.144+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:09.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:09.447+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:09.686 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:09.677+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:09.775 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:09.765+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:09.811 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:09.801+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:10.029 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:10.019+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:10.100 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:10.090+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:10.205 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:10.196+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:10.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:10.416+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:10.711 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:10.701+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:10.823 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:10.814+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:10.864 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:10.855+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:10.986 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:10.976+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:11.070 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:11.062+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:11.172 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:11.162+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:11.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:11.405+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:57:11.673 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:57:11.663+0000 1694f700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.178256+0000 front 2019-12-11T19:55:52.198632+0000 (oldest deadline 2019-12-11T19:56:33.255612+0000) 2019-12-11T19:57:11.801 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:57:11.789+0000 1694f700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.526611+0000 front 2019-12-11T19:55:52.630375+0000 (oldest deadline 2019-12-11T19:56:33.584274+0000) 2019-12-11T19:57:11.897 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:57:11.890+0000 1694f700 -1 osd.0 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.819294+0000 front 2019-12-11T19:55:50.925486+0000 (oldest deadline 2019-12-11T19:56:34.288141+0000) 2019-12-11T19:57:12.002 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:57:11.992+0000 1694f700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:49.826227+0000 front 2019-12-11T19:55:49.785490+0000 (oldest deadline 2019-12-11T19:56:34.438415+0000) 2019-12-11T19:57:12.117 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:57:12.108+0000 1694f700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:52.496601+0000 front 2019-12-11T19:55:52.508753+0000 (oldest deadline 2019-12-11T19:56:34.738100+0000) 2019-12-11T19:57:12.122 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:57:12.113+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.73:6802/10521,v1:172.21.15.73:6803/10521] for 42sec e346 v346) 2019-12-11T19:57:12.208 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:57:12.188+0000 1694f700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:51.882807+0000 front 2019-12-11T19:55:51.827152+0000 (oldest deadline 2019-12-11T19:56:34.039611+0000) 2019-12-11T19:57:12.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:57:12.387+0000 1694f700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.73:6806 osd.2 since back 2019-12-11T19:55:50.375024+0000 front 2019-12-11T19:55:50.167724+0000 (oldest deadline 2019-12-11T19:56:33.654050+0000) 2019-12-11T19:58:06.125 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:06.118+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:07.093 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:07.085+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:08.120 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:08.112+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:09.100 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:09.092+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:09.116 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:09.107+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:09.668 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:09.661+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:09.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:09.720+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:10.090 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:10.082+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:10.132 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:10.125+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:10.710 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:10.703+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:10.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:10.749+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:11.097 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:11.088+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:11.115 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:11.107+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:11.714 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:11.706+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:11.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:11.751+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:12.054 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:12.047+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:12.111 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:12.103+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:12.467 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:12.458+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:12.720 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:12.713+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:12.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:12.745+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:13.027 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:13.017+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:13.027 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:13.019+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:13.085 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:13.077+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:13.159 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:13.150+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:13.433 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:13.425+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:13.772 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:13.764+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:13.773 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:13.764+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:13.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:13.786+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:13.990 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:13.981+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:13.991 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:13.983+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:14.082 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:14.075+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:14.211 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:14.203+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:14.488 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:14.479+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:14.772 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:14.765+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:14.796 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:14.787+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:14.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:14.838+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:14.979 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:14.972+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:14.983 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:14.976+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:15.080 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:15.064+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:15.216 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:15.207+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:15.485 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:15.476+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:15.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:15.766+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:15.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:15.810+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:15.826 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:15.818+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:16.014 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:16.003+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:16.016 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:16.006+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:16.047 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:16.038+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:16.231 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:16.223+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:16.453 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:16.445+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:16.748 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:16.741+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:16.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:16.828+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:16.862 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:16.853+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:17.037 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:17.031+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:17.067 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:17.057+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:17.069 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:17.060+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:17.220 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:17.212+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:17.451 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:17.442+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:17.701 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:17.694+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:17.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:17.871+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:17.905 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:17.896+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:18.088 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:18.082+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:18.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:18.080+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:18.091 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:18.082+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:18.179 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:18.171+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:18.446 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:18.437+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:18.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:18.670+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:18.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:18.863+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:18.908 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:18.899+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:19.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:19.081+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:19.092 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:19.085+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:19.108 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:19.101+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:19.179 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:19.171+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:19.470 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:19.461+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:19.635 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:19.627+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:19.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:19.840+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:19.914 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:19.906+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:20.105 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:20.097+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:20.106 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:20.099+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:20.161 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:20.153+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:20.208 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:20.200+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:20.509 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:20.501+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:20.660 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:20.654+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:20.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:20.864+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:20.894 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:20.884+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:21.112 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:21.103+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:21.113 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:21.105+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:21.197 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:21.190+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:21.203 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:21.196+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:21.524 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:21.515+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:21.650 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:21.643+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:21.921 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:21.912+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:21.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:21.914+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:22.122 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:22.114+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:22.122 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:22.115+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:22.161 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:22.154+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:22.198 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:22.189+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:22.490 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:22.481+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:22.676 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:22.669+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:22.943 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:22.934+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:22.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:22.945+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:23.115 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:23.108+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:23.119 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:23.113+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:23.188 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:23.179+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:23.210 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:23.202+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:23.491 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:23.482+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:23.716 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:23.709+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:23.951 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:23.942+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:23.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:23.971+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:24.129 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:24.122+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:24.131 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:24.124+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:24.214 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:24.206+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:24.219 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:24.213+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:24.522 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:24.513+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:24.728 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:24.721+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:24.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:24.975+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:24.996 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:24.987+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:25.119 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:25.111+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:25.120 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:25.113+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:25.218 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:25.209+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:25.265 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:25.257+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:25.560 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:25.551+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:25.698 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:25.691+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:25.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:25.940+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:25.986 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:25.978+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:26.088 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:26.079+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:26.089 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:26.081+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:26.247 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:26.240+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:26.298 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:26.288+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:26.521 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:26.512+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:26.694 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:26.686+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:26.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:26.927+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:27.037 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:27.029+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:27.047 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:27.039+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:27.051 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:27.043+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:27.261 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:27.251+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:27.320 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:27.313+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:27.531 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:27.523+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:27.682 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:27.676+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:27.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:27.939+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:28.023 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:28.015+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:28.024 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:28.016+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:28.046 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:28.037+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:28.308 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:28.301+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:28.313 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:28.304+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:28.528 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:28.520+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:28.710 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:28.703+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:28.982 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:28.976+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:28.985 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:28.978+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:29.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:28.993+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:29.024 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:29.015+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:29.331 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:29.322+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:29.334 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:29.326+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:29.523 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:29.514+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:29.710 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:29.702+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:29.941 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:29.932+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:29.942 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:29.934+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:30.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:30.002+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:30.025 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:30.017+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:30.327 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:30.319+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:30.380 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:30.372+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:30.561 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:30.551+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:30.665 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:30.657+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:30.993 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:30.984+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:30.994 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:30.986+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:31.049 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:31.040+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:31.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:31.047+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:31.299 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:31.290+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:31.388 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:31.381+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:31.609 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:31.599+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:31.677 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:31.670+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:32.032 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:32.025+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:32.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:32.027+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:32.036 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:32.029+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:32.082 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:32.072+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:32.279 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:32.270+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:32.395 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:32.388+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:32.604 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:32.595+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:32.713 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:32.705+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:33.030 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:33.022+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:33.031 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:33.024+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:33.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:33.050+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:33.089 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:33.079+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:33.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:33.314+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:33.394 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:33.387+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:33.590 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:33.580+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:33.678 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:33.670+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:34.014 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:34.003+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:34.015 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:34.005+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:34.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:34.030+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:34.136 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:34.126+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:34.319 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:34.309+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:34.389 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:34.380+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:34.635 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:34.625+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:34.697 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:34.689+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:34.966 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:34.958+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:34.969 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:34.960+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:35.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:35.054+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:35.184 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:35.175+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:35.285 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:35.276+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:35.348 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:35.339+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:35.643 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:35.633+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:35.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:35.648+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:35.957 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:35.950+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:35.961 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:35.953+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:36.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:36.045+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:36.172 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:36.162+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:36.308 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:36.298+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:36.322 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:36.310+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:36.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:36.625+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:36.690 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:36.680+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:36.961 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:36.954+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:36.965 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:36.957+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:37.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:37.098+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:37.169 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:37.159+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:37.273 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:37.265+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:37.338 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:37.328+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:37.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:37.618+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:37.683 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:37.675+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:37.942 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:37.931+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:37.943 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:37.933+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:38.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:38.148+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:38.159 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:38.150+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:38.308 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:38.301+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:38.332 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:38.322+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:38.632 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:38.624+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:38.717 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:38.708+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:38.936 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:38.927+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:38.937 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:38.930+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:39.167 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:39.158+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:39.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:39.173+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:39.303 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:39.293+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:39.355 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:39.347+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:39.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:39.648+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:39.681 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:39.671+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:39.984 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:39.976+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:39.985 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:39.978+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:40.125 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:40.116+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:40.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:40.173+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:40.294 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:40.285+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:40.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:40.396+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:40.664 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:40.656+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:40.725 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:40.716+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:40.983 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:40.975+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:40.984 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:40.976+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:41.159 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:41.149+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:41.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:41.208+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:41.340 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:41.330+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:41.453 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:41.446+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:41.701 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:41.694+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:41.741 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:41.730+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:42.039 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:42.024+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:42.042 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:42.027+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:42.124 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:42.115+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:42.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:42.216+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:42.358 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:42.347+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:42.452 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:58:42.443+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e352 v352) 2019-12-11T19:58:42.460 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:42.453+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:42.707 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:42.697+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:42.724 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:42.717+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:43.018 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:43.010+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:43.018 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:43.011+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:43.114 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:43.104+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:43.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:43.197+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:43.354 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:43.344+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:43.480 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:43.472+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:43.727 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:43.721+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:43.744 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:43.732+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:43.993 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:43.985+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:43.994 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:43.986+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:44.092 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:44.083+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:44.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:44.184+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:44.325 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:44.316+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:44.533 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:44.526+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:44.706 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:44.693+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:44.714 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:44.705+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:45.041 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:45.032+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:45.042 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:45.034+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:45.113 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:45.104+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:45.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:45.147+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:45.285 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:45.276+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:45.555 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:45.547+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:45.706 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:45.699+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:45.719 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:45.711+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:46.016 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:46.010+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:46.020 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:46.013+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:46.140 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:46.128+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:46.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:46.146+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:46.290 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:46.281+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:46.542 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:46.536+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:46.686 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:46.679+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:46.720 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:46.711+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:46.985 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:46.977+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:46.986 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:46.979+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:47.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:47.152+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:47.186 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:47.177+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:47.268 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:47.260+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:47.460 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:58:47.450+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e352 v352) 2019-12-11T19:58:47.522 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:47.515+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:47.727 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:47.720+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:47.770 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:47.762+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:47.961 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:47.953+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:47.963 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:47.955+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:48.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:48.169+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:48.229 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:48.221+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:48.245 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:48.237+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:48.517 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:48.510+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:48.693 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:48.687+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:48.802 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:48.793+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:49.010 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:49.002+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:49.011 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:49.003+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:49.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:49.218+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:49.229 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:49.221+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:49.281 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:49.272+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:49.504 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:49.497+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:49.721 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:49.714+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:49.790 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:49.782+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:49.974 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:49.967+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:49.980 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:49.971+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:50.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:50.214+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:50.246 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:50.238+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:50.322 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:50.313+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:50.490 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:50.483+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:50.738 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:50.730+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:50.816 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:50.808+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:50.959 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:50.950+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:50.960 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:50.952+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:51.216 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:51.207+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:51.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:51.234+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:51.355 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:51.347+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:51.454 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:51.447+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:51.735 INFO:tasks.ceph.osd.3.smithi073.stderr:2019-12-11T19:58:51.728+0000 1694f700 -1 osd.3 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:23.803127+0000 front 2019-12-11T19:57:23.800156+0000 (oldest deadline 2019-12-11T19:58:09.521823+0000) 2019-12-11T19:58:51.870 INFO:tasks.ceph.osd.6.smithi150.stderr:2019-12-11T19:58:51.862+0000 1694f700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.866021+0000 front 2019-12-11T19:57:27.999876+0000 (oldest deadline 2019-12-11T19:58:12.425536+0000) 2019-12-11T19:58:51.914 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:51.906+0000 1694f700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 ever on either front or back, first ping sent 2019-12-11T19:57:32.423580+0000 (oldest deadline 2019-12-11T19:58:12.423580+0000) 2019-12-11T19:58:51.915 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:51.907+0000 1694f700 -1 osd.2 352 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:58:52.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2019-12-11T19:58:52.228+0000 1694f700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:25.365075+0000 front 2019-12-11T19:57:25.354162+0000 (oldest deadline 2019-12-11T19:58:09.588063+0000) 2019-12-11T19:58:52.263 INFO:tasks.ceph.osd.5.smithi150.stderr:2019-12-11T19:58:52.253+0000 1694f700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:28.150210+0000 front 2019-12-11T19:57:28.001916+0000 (oldest deadline 2019-12-11T19:58:13.057941+0000) 2019-12-11T19:58:52.355 INFO:tasks.ceph.osd.4.smithi150.stderr:2019-12-11T19:58:52.347+0000 1694f700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:27.048675+0000 front 2019-12-11T19:57:29.014887+0000 (oldest deadline 2019-12-11T19:58:08.872088+0000) 2019-12-11T19:58:52.491 INFO:tasks.ceph.osd.0.smithi073.stderr:2019-12-11T19:58:52.484+0000 1694f700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.150:6804 osd.7 since back 2019-12-11T19:57:29.399220+0000 front 2019-12-11T19:57:28.752407+0000 (oldest deadline 2019-12-11T19:58:12.061318+0000) 2019-12-11T19:58:52.559 INFO:tasks.ceph.mon.a.smithi073.stderr:2019-12-11T19:58:52.545+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.7 [v2:172.21.15.150:6800/10187,v1:172.21.15.150:6801/10187] for 46sec e352 v352) 2019-12-11T19:58:53.197 INFO:tasks.ceph.osd.2.smithi073.stderr:2019-12-11T19:58:53.053+0000 1694f700 -1 osd.2 353 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4355.0:85120 7.8 7.f842a178 (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-12-11T19:59:07.524 INFO:tasks.ceph.osd.7.smithi150.stderr:*** Caught signal (Segmentation fault) ** 2019-12-11T19:59:07.524 INFO:tasks.ceph.osd.7.smithi150.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-11T19:59:07.575 INFO:tasks.ceph.osd.7.smithi150.stderr: ceph version 15.0.0-7936-g827e03c (827e03c8a6b1e17d93dcaf79724437bac291c35b) octopus (dev) 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-11T19:59:07.576 INFO:tasks.ceph.osd.7.smithi150.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-11T19:59:07.577 INFO:tasks.ceph.osd.7.smithi150.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-11T19:59:09.016 INFO:tasks.ceph.osd.7.smithi150.stderr:2019-12-11T19:59:08.126+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-11T19:59:09.016 INFO:tasks.ceph.osd.7.smithi150.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-11T19:59:09.017 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:09.017 INFO:tasks.ceph.osd.7.smithi150.stderr: ceph version 15.0.0-7936-g827e03c (827e03c8a6b1e17d93dcaf79724437bac291c35b) octopus (dev) 2019-12-11T19:59:09.017 INFO:tasks.ceph.osd.7.smithi150.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-11T19:59:09.017 INFO:tasks.ceph.osd.7.smithi150.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-11T19:59:09.018 INFO:tasks.ceph.osd.7.smithi150.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-11T19:59:09.018 INFO:tasks.ceph.osd.7.smithi150.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-11T19:59:09.018 INFO:tasks.ceph.osd.7.smithi150.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-11T19:59:09.018 INFO:tasks.ceph.osd.7.smithi150.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-11T19:59:09.019 INFO:tasks.ceph.osd.7.smithi150.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-11T19:59:09.019 INFO:tasks.ceph.osd.7.smithi150.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-11T19:59:09.019 INFO:tasks.ceph.osd.7.smithi150.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-11T19:59:09.019 INFO:tasks.ceph.osd.7.smithi150.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-11T19:59:09.020 INFO:tasks.ceph.osd.7.smithi150.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-11T19:59:09.020 INFO:tasks.ceph.osd.7.smithi150.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-11T19:59:09.020 INFO:tasks.ceph.osd.7.smithi150.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-11T19:59:09.020 INFO:tasks.ceph.osd.7.smithi150.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-11T19:59:09.021 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:09.848 INFO:tasks.ceph.osd.7.smithi150.stderr: -1590> 2019-12-11T19:59:08.126+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: ceph version 15.0.0-7936-g827e03c (827e03c8a6b1e17d93dcaf79724437bac291c35b) octopus (dev) 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-11T19:59:09.849 INFO:tasks.ceph.osd.7.smithi150.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-11T19:59:09.850 INFO:tasks.ceph.osd.7.smithi150.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-11T19:59:09.851 INFO:tasks.ceph.osd.7.smithi150.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-11T19:59:09.851 INFO:tasks.ceph.osd.7.smithi150.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-11T19:59:09.851 INFO:tasks.ceph.osd.7.smithi150.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-11T19:59:09.851 INFO:tasks.ceph.osd.7.smithi150.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-11T19:59:09.851 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:10.222 INFO:tasks.ceph.osd.7.smithi150.stderr: -2591> 2019-12-11T19:59:08.126+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-11T19:59:10.222 INFO:tasks.ceph.osd.7.smithi150.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-11T19:59:10.222 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: ceph version 15.0.0-7936-g827e03c (827e03c8a6b1e17d93dcaf79724437bac291c35b) octopus (dev) 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-11T19:59:10.223 INFO:tasks.ceph.osd.7.smithi150.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-11T19:59:10.224 INFO:tasks.ceph.osd.7.smithi150.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-11T19:59:10.224 INFO:tasks.ceph.osd.7.smithi150.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-11T19:59:10.224 INFO:tasks.ceph.osd.7.smithi150.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-11T19:59:10.224 INFO:tasks.ceph.osd.7.smithi150.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-11T19:59:10.224 INFO:tasks.ceph.osd.7.smithi150.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-11T19:59:10.225 INFO:tasks.ceph.osd.7.smithi150.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-11T19:59:10.225 INFO:tasks.ceph.osd.7.smithi150.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-11T19:59:10.225 INFO:tasks.ceph.osd.7.smithi150.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-11T19:59:10.225 INFO:tasks.ceph.osd.7.smithi150.stderr: 2019-12-11T19:59:13.257 INFO:tasks.ceph.osd.7.smithi150.stderr:daemon-helper: command crashed with signal 11 2019-12-11T19:59:18.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2019-12-11T19:59:24.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2019-12-11T19:59:27.787 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:28.004 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:27.813 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:28.029 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:27.828 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:28.044 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:27.836 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:28.051 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:27.885 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:28.059 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:27.888 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:28.062 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:28.001 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:28.218 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:28.027 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:28.244 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:28.168 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:28.342 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:30.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~13s 2019-12-11T19:59:37.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~19s 2019-12-11T19:59:43.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2019-12-11T19:59:46.143 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:46.359 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.150 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:46.366 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.162 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:46.378 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.170 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:46.386 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.182 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:46.355 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.195 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:17:46.411 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.207 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:17:46.424 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.232 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:46.405 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:46.305 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:17:46.479 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T19:59:49.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~32s 2019-12-11T19:59:56.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~38s 2019-12-11T20:00:02.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~44s 2019-12-11T20:00:08.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2019-12-11T20:00:15.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~57s 2019-12-11T20:00:21.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~63s 2019-12-11T20:00:27.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~69s 2019-12-11T20:00:34.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~76s 2019-12-11T20:00:40.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~82s 2019-12-11T20:00:46.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~88s 2019-12-11T20:00:52.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2019-12-11T20:00:59.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~101s 2019-12-11T20:01:05.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~107s 2019-12-11T20:01:11.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~114s 2019-12-11T20:01:18.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2019-12-11T20:01:24.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~126s 2019-12-11T20:01:30.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~133s 2019-12-11T20:01:37.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~139s 2019-12-11T20:01:43.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2019-12-11T20:01:49.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~151s 2019-12-11T20:01:56.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~158s 2019-12-11T20:02:02.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~164s 2019-12-11T20:02:08.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2019-12-11T20:02:15.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~177s 2019-12-11T20:02:21.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~183s 2019-12-11T20:02:27.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~189s 2019-12-11T20:02:33.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~196s 2019-12-11T20:02:40.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~202s 2019-12-11T20:02:46.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~208s 2019-12-11T20:02:52.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2019-12-11T20:02:59.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~221s 2019-12-11T20:03:05.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~227s 2019-12-11T20:03:11.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~234s 2019-12-11T20:03:18.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2019-12-11T20:03:24.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~246s 2019-12-11T20:03:30.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~252s 2019-12-11T20:03:37.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~259s 2019-12-11T20:03:43.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2019-12-11T20:03:49.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~271s 2019-12-11T20:03:56.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~278s 2019-12-11T20:04:02.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~284s 2019-12-11T20:04:08.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2019-12-11T20:04:14.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~297s 2019-12-11T20:04:21.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~303s 2019-12-11T20:04:21.297 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-11T20:04:21.297 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-abhi-testing-2019-12-04-1433/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-11T20:04:55.094 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:22:55.310 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.104 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:22:55.320 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.108 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:22:55.325 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.113 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:22:55.329 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.116 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:22:55.289 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.126 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:22:55.299 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.357 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:22:55.573 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.360 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:22:55.577 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:04:55.409 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:22:55.583 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.543 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:25:49.759 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.548 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:25:49.765 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.570 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:25:49.786 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.607 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:25:49.823 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.638 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:25:49.811 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.653 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:25:49.827 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.670 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:25:49.887 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.761 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:25:49.974 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:07:49.806 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:25:49.979 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.229 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:27:40.445 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.245 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:27:40.418 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.245 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:27:40.453 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.251 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:27:40.424 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.251 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:27:40.468 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.255 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:27:40.472 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.403 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:27:40.577 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:27:40.686 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:09:40.475 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:27:40.691 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.942 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:32:35.158 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.945 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:32:35.162 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.958 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:32:35.174 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.961 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:32:35.178 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.981 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:32:35.151 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:34.993 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:32:35.167 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:35.139 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:32:35.355 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:35.155 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:32:35.372 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:14:35.311 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:32:35.485 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.437 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:34:11.653 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.450 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:34:11.667 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.499 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:34:11.715 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.503 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:34:11.720 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.504 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:34:11.721 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.533 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:34:11.708 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.538 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:34:11.712 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.560 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:34:11.776 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:16:11.630 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:34:11.804 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.130 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:36:37.346 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.135 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:36:37.351 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.348 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:36:37.522 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.356 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:36:37.525 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.368 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:36:37.585 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.377 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:36:37.594 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.382 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:36:37.599 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.467 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:36:37.641 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:18:37.472 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:36:37.688 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.295 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:37:46.512 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.308 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:37:46.525 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.315 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:37:46.532 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.322 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:37:46.539 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.335 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:37:46.509 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.357 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:37:46.532 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.384 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:37:46.601 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.386 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:37:46.602 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:19:46.530 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:37:46.704 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.334 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:33.551 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.351 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:33.554 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.394 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:33.610 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.395 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:33.612 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.429 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:33.601 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.435 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:33.610 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.470 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:33.687 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.519 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:33.736 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:33.605 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:33.779 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.450 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:56.666 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.456 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:56.672 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.465 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:56.682 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:56.686 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.486 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:56.659 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.490 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:42:56.706 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.503 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:56.677 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.518 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:42:56.735 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:24:56.589 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:42:56.763 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.280 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:48:09.497 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.287 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:48:09.504 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.306 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:48:09.523 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.312 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:48:09.529 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.313 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:48:09.488 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.349 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:48:09.523 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.499 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:48:09.716 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.504 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:48:09.722 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:30:09.601 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:48:09.776 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.893 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:50:55.110 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.935 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:50:55.152 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.949 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:50:55.124 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.952 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:50:55.169 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.954 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:50:55.171 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:54.964 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:50:55.139 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:55.035 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:50:55.252 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:55.054 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:50:55.229 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:32:55.055 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:50:55.272 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.477 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:53:20.694 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.479 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:53:20.696 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.496 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:53:20.713 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.497 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:53:20.672 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.500 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:53:20.718 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.508 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:53:20.683 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.597 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:53:20.814 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.630 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:53:20.847 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:35:20.677 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:53:20.852 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:33.992 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:58:34.209 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.002 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:58:34.220 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.016 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:58:34.233 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.020 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:58:34.237 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.030 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:58:34.205 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.051 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:58:34.226 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.230 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:58:34.448 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.301 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:58:34.518 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:40:34.301 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:58:34.477 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.458 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:59:16.675 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.465 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:59:16.683 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.533 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:59:16.708 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.536 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:59:16.711 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.540 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:59:16.757 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.543 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:59:16.761 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.560 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:06:59:16.778 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.580 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:06:59:16.797 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:41:16.608 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:06:59:16.784 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.180 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:03:44.397 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.192 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:03:44.410 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.200 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:03:44.418 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.204 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:03:44.422 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.216 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:03:44.390 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.224 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:03:44.399 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.401 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:03:44.619 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.412 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:03:44.629 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:45:44.450 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:03:44.625 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.281 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:07:38.498 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.294 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:07:38.512 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.328 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:07:38.545 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.333 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:07:38.551 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.363 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:07:38.539 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.375 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:07:38.551 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.397 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:07:38.615 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.482 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:07:38.698 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:49:38.529 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:07:38.704 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.363 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:08:56.581 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.369 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:08:56.587 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.375 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:08:56.593 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.380 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:08:56.598 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.387 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:08:56.562 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.391 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:08:56.567 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.437 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:08:56.654 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.444 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:08:56.661 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:50:56.519 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:08:56.694 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:09.516 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:14:09.724 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.109 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:14:09.715 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.109 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:14:09.734 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.109 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:14:10.008 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.110 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:14:09.735 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.110 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:14:09.942 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.110 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:14:09.751 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.110 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:14:09.757 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:56:10.110 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:14:09.981 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:04.837 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:16:05.046 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.919 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:16:05.066 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:16:05.089 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:16:05.235 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:16:05.054 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:16:05.144 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:16:05.091 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.920 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:16:05.095 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:58:05.921 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:16:05.149 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.434 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:17:40.652 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.487 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:17:40.705 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.516 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:17:40.735 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.534 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:17:40.753 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.553 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:17:40.729 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.556 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:17:40.732 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.570 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:17:40.789 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.645 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:17:40.863 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T20:59:40.756 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:17:40.932 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.679 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:19:18.897 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.686 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:19:18.904 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.698 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:19:18.916 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.702 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:19:18.920 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.712 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:19:18.888 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.728 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:19:18.901 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.763 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:19:18.981 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.779 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:19:18.997 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:01:18.848 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:19:19.018 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.778 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:26.996 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.796 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:27.014 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.818 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:27.036 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.833 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:27.051 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.852 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:27.028 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.861 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:27.037 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.929 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:27.148 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:26.966 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:27.184 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:27.049 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:27.225 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.899 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:31.117 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.913 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:31.131 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.919 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:31.137 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.924 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:31.143 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.933 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:31.110 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.941 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:24:31.160 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.944 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:31.120 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:30.949 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:24:31.167 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:06:31.002 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:24:31.178 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.872 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:29:43.090 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.876 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:29:43.094 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.889 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:29:43.107 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.894 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:29:43.113 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.901 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:29:43.077 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:42.925 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:29:43.099 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:43.052 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:29:43.270 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:43.073 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:29:43.292 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:11:43.179 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:29:43.356 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.369 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:32:48.588 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.413 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:32:48.632 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.446 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:32:48.664 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.448 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:32:48.666 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.478 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:32:48.654 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.484 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:32:48.661 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.506 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:32:48.725 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.538 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:32:48.757 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:14:48.593 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:32:48.770 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.808 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:34:54.025 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.814 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:34:54.033 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.820 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:34:54.040 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.833 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:34:54.052 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.863 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:34:54.040 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.874 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:34:54.051 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.917 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:34:54.136 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:53.920 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:34:54.139 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:16:54.061 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:34:54.237 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.803 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:40:06.022 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.809 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:40:06.028 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.822 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:40:06.041 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.825 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:40:06.045 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.838 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:40:06.015 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:05.854 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:40:06.032 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:06.057 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:40:06.234 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:06.098 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:40:06.317 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:22:06.099 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:40:06.319 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:09.952 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:41:10.172 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:09.991 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:41:10.210 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:09.999 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:41:10.218 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.002 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:41:10.221 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.039 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:41:10.216 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.050 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:41:10.227 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.053 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:41:10.272 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.057 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:41:10.276 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:23:10.211 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:41:10.388 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.906 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:45:17.125 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.915 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:45:17.134 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.940 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:45:17.117 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.951 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:45:17.170 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.955 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:45:17.175 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:16.961 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:45:17.139 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:17.108 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:45:17.327 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:17.135 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:45:17.354 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:27:17.189 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:45:17.366 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.586 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:49:31.806 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.658 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:49:31.877 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.687 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:49:31.864 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.695 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:49:31.872 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.699 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:49:31.918 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.704 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:49:31.923 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.840 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:49:32.060 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.884 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:49:32.103 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:31:31.934 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:49:32.111 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:26.973 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:50:27.193 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:26.982 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:50:27.201 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:26.991 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:50:27.210 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:26.993 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:50:27.213 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:27.010 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:50:27.187 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:27.021 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:50:27.198 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:27.032 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:50:27.251 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:27.044 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:50:27.263 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:32:27.141 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:50:27.318 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.937 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:55:40.156 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.943 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:55:40.162 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.954 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:55:40.174 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.959 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:55:40.179 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.970 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:55:40.147 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:39.989 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:55:40.166 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:40.146 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:55:40.365 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:40.147 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:55:40.367 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:37:40.230 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:55:40.407 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.313 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:57:53.532 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.316 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:57:53.535 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.350 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:57:53.527 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.360 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:57:53.537 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.380 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:57:53.599 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.384 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:57:53.604 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.385 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:57:53.604 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.445 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:57:53.622 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:39:53.458 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:57:53.677 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.713 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:58:38.932 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.732 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:58:38.951 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.771 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:58:38.990 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.777 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:58:38.954 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.784 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:07:58:39.004 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.794 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:58:39.014 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.827 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:58:39.005 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.837 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:07:58:39.057 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:40:38.913 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:07:58:39.090 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.346 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:00:49.565 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.353 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:00:49.573 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.366 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:00:49.585 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.369 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:00:49.589 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.379 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:00:49.552 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.395 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:00:49.572 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.459 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:00:49.678 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.489 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:00:49.708 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:42:49.576 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:00:49.753 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.408 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:00.627 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.413 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:00.632 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.424 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:00.644 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.430 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:00.650 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.434 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:00.612 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.455 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:00.633 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.590 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:00.809 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.616 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:00.836 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:00.664 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:00.842 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.282 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:15.502 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.304 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:15.523 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.322 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:15.542 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.338 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:06:15.557 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.355 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:15.574 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.375 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:15.552 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.378 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:15.555 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.382 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:06:15.602 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:48:15.418 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:06:15.596 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.419 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:11:12.638 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.422 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:11:12.642 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.442 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:11:12.619 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.447 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:11:12.625 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.492 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:11:12.712 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.497 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:11:12.717 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.603 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:11:12.822 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.689 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:11:12.866 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:53:12.732 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:11:12.952 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.880 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:14:37.099 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.885 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:14:37.105 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.899 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:14:37.119 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.905 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:14:37.125 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.944 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:14:37.121 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.950 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:14:37.128 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:36.996 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:14:37.216 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:37.054 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:14:37.274 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:56:37.069 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:14:37.247 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.621 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:16:24.840 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.632 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:16:24.850 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.641 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:16:24.860 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.646 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:16:24.865 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.651 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:16:24.828 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.674 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:16:24.850 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.710 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:16:24.928 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.727 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:16:24.945 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T21:58:24.881 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:16:25.058 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.264 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:21:36.483 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.278 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:21:36.490 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.280 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:21:36.500 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.283 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:21:36.503 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.289 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:21:36.466 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.296 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:21:36.474 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.469 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:21:36.689 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.523 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:21:36.697 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:03:36.562 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:21:36.782 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.594 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:22:58.814 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.598 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:22:58.818 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.658 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:22:58.878 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.665 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:22:58.843 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.670 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:22:58.890 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.675 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:22:58.895 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.678 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:22:58.856 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.722 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:22:58.942 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:04:58.763 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:22:58.941 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.585 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:26:47.804 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.593 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:26:47.812 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.604 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:26:47.824 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.607 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:26:47.827 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.619 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:26:47.796 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.633 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:26:47.805 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.744 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:26:47.964 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.756 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:26:47.976 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:08:47.812 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:26:47.990 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.338 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:20.557 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.345 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:20.565 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.388 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:20.608 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.390 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:20.610 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.436 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:20.614 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.438 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:20.616 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.486 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:20.707 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.516 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:20.736 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:20.615 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:20.793 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.143 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:59.363 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.154 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:59.374 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.158 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:59.379 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.164 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:59.384 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.165 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:59.343 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.176 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:59.354 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.197 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:31:59.417 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.210 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:31:59.430 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:13:59.307 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:31:59.485 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.505 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:37:11.725 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.511 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:37:11.731 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.523 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:37:11.740 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.524 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:37:11.744 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.540 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:37:11.718 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.591 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:37:11.769 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.685 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:37:11.905 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.708 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:37:11.928 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:19:11.815 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:37:11.993 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.875 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:42.095 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.893 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:42.113 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.929 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:42.149 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.930 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:42.151 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.936 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:42.114 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.946 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:42.124 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:41.984 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:42.205 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:42.004 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:42.224 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:42.081 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:42.259 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.174 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:57.394 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.206 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:57.426 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.230 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:57.450 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.236 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:57.456 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.237 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:39:57.457 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.264 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:39:57.484 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.284 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:57.462 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.323 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:57.502 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:21:57.372 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:39:57.550 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.583 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:42:21.803 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.596 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:42:21.816 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.605 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:42:21.784 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.607 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:42:21.827 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.610 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:42:21.789 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.612 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:42:21.833 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.701 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:42:21.921 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.714 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:42:21.935 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:24:21.764 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:42:21.943 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.921 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:47:34.141 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.944 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:47:34.114 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.945 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:47:34.152 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.945 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:47:34.154 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.945 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:47:34.161 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:33.950 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:47:34.128 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:34.131 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:47:34.351 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:34.135 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:47:34.356 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:29:34.160 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:47:34.338 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.898 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:48:04.118 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.916 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:48:04.137 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.917 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:48:04.138 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.921 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:48:04.141 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.945 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:48:04.165 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:03.972 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:48:04.192 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:04.001 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:48:04.174 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:04.004 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:48:04.183 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:30:04.064 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:48:04.242 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.791 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:52:45.012 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.814 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:52:45.019 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.814 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:52:45.031 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.814 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:52:45.035 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.821 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:52:45.000 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.853 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:52:45.031 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.980 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:52:45.200 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:44.998 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:52:45.219 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:34:45.091 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:52:45.269 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.590 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:56:30.810 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.616 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:56:30.836 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.644 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:56:30.864 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.648 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:56:30.868 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.687 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:56:30.865 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.693 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:56:30.872 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.729 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:56:30.950 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.787 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:56:31.007 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:38:30.903 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:56:31.081 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:56.947 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:57:57.168 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:56.955 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:57:57.176 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:56.963 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:57:57.183 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:56.969 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:57:57.189 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:57.034 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:08:57:57.254 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:57.035 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:08:57:57.256 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:57.065 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:57:57.243 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:57.094 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:57:57.273 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:39:57.254 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:08:57:57.432 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:12.982 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:03:13.202 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:12.996 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:03:13.215 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.001 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:03:13.180 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.003 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:03:13.224 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.007 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:03:13.228 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.009 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:03:13.187 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.183 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:03:13.404 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.212 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:03:13.390 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:45:13.218 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:03:13.438 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.191 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:04:52.411 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.217 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:04:52.437 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.248 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:04:52.468 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.274 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:04:52.494 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.285 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:04:52.463 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.289 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:04:52.510 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.292 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:04:52.471 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.344 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:04:52.564 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:46:52.381 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:04:52.559 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:22.982 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:08:23.202 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:22.988 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:08:23.208 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.018 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:08:23.197 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.039 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:08:23.218 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.060 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:08:23.281 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.065 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:08:23.286 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.179 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:08:23.400 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.224 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:08:23.445 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:50:23.364 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:08:23.543 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.789 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:14.009 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.808 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:14.028 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.839 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:14.059 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.840 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:14.061 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:14.043 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.869 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:14.048 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.944 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:14.165 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:13.964 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:14.178 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:14.044 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:14.222 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.023 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:35.243 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.029 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:35.250 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.042 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:35.262 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.046 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:35.266 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.055 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:35.233 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.059 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:35.238 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.073 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:13:35.294 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.093 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:13:35.313 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T22:55:35.137 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:13:35.315 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:44.995 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:18:45.215 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.001 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:18:45.221 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.013 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:18:45.233 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.016 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:18:45.237 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.023 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:18:45.202 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.049 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:18:45.227 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.199 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:18:45.419 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.242 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:18:45.463 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:00:45.363 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:18:45.542 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.387 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:20:20.608 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.396 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:20:20.616 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.465 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:20:20.686 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.469 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:20:20.690 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.504 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:20:20.683 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.508 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:20:20.687 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.515 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:20:20.736 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.543 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:20:20.763 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:02:20.622 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:20:20.801 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.719 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:21:35.939 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.727 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:21:35.947 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.761 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:21:35.982 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.767 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:21:35.987 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.770 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:21:35.991 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.813 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:21:35.992 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.816 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:21:35.995 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.836 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:21:36.056 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:03:35.991 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:21:36.169 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.386 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:23:56.607 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.393 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:23:56.613 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.402 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:23:56.622 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.408 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:23:56.628 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.414 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:23:56.592 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.424 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:23:56.602 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.490 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:23:56.710 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.529 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:23:56.708 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:05:56.555 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:23:56.775 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.317 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:29:09.538 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.322 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:29:09.543 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.336 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:29:09.557 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.341 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:29:09.562 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.344 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:29:09.523 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.356 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:29:09.535 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.498 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:29:09.718 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.591 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:29:09.811 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:11:09.626 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:29:09.805 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.489 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:30:02.710 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.502 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:30:02.723 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.512 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:30:02.733 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.538 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:30:02.758 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.539 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:30:02.760 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.570 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:30:02.749 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.576 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:30:02.797 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.580 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:30:02.759 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:12:02.719 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:30:02.898 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.519 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:34:21.740 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.526 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:34:21.747 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.538 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:34:21.759 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.543 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:34:21.764 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.559 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:34:21.738 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.584 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:34:21.763 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.694 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:34:21.915 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.789 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:34:22.010 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:16:21.851 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:34:22.030 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.083 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:38:24.304 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.112 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:38:24.310 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.112 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:38:24.326 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.112 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:38:24.332 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.179 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:38:24.358 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.185 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:38:24.365 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.199 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:38:24.420 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.325 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:38:24.504 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:20:24.338 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:38:24.560 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.712 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:39:31.933 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.717 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:39:31.938 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.724 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:39:31.945 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.726 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:39:31.947 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.736 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:39:31.915 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.742 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:39:31.921 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.777 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:39:31.998 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.783 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:39:32.004 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:21:31.880 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:39:32.060 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.417 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:44:45.637 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.422 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:44:45.643 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.433 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:44:45.655 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.434 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:44:45.614 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.438 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:44:45.660 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.442 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:44:45.621 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.637 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:44:45.858 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.682 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:44:45.903 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:26:45.714 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:44:45.894 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.709 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:46:50.930 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.742 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:46:50.963 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.756 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:46:50.978 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.767 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:46:50.988 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.794 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:46:50.974 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.801 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:46:50.980 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.812 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:46:51.034 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.850 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:46:51.071 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:28:50.926 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:46:51.106 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.119 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:49:56.341 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.126 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:49:56.347 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.133 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:49:56.355 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.137 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:49:56.359 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.152 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:49:56.332 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.172 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:49:56.352 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.257 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:49:56.479 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.262 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:49:56.483 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:31:56.446 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:49:56.626 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.251 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:07.473 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.261 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:07.483 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.269 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:07.491 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.275 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:07.497 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.284 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:07.464 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.302 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:07.482 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.442 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:07.664 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.476 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:07.698 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:07.581 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:07.761 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.842 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:13.063 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.848 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:13.070 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.870 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:09:55:13.091 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.875 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:13.097 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.902 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:13.123 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.915 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:09:55:13.137 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.941 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:13.121 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.947 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:13.127 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:37:12.976 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:09:55:13.156 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.450 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:18.672 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.458 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:18.680 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:18.692 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.475 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:18.697 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.483 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:18.663 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.487 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:18.667 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.686 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:18.907 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.708 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:18.930 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:18.731 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:18.902 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.296 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:59.517 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.300 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:59.521 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.362 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:59.584 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.365 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:59.587 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.379 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:59.559 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.380 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:59.561 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.395 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:00:59.617 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.408 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:00:59.630 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:42:59.424 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:00:59.604 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.927 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:03:35.149 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.932 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:03:35.154 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.970 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:03:35.150 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.978 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:03:35.158 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.988 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:03:35.210 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:34.990 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:03:35.212 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:35.011 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:03:35.233 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:35.064 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:03:35.285 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:45:35.087 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:03:35.267 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.567 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:05:26.789 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.599 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:05:26.796 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.600 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:05:26.804 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.600 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:05:26.808 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.600 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:05:26.779 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.649 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:05:26.829 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.657 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:05:26.879 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.686 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:05:26.907 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:47:26.797 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:05:26.978 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.829 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:10:39.051 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.860 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:10:39.032 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.861 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:10:39.060 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.861 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:10:39.070 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.861 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:10:39.075 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:38.891 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:10:39.072 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:39.055 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:10:39.277 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:39.124 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:10:39.346 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:52:39.125 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:10:39.305 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.543 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:11:56.764 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.561 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:11:56.783 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.582 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:11:56.804 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.606 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:11:56.828 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.608 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:11:56.789 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.609 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:11:56.831 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.619 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:11:56.799 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.653 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:11:56.875 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:53:56.723 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:11:56.904 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.029 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:15:51.251 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.033 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:15:51.255 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.042 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:15:51.264 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.046 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:15:51.268 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.060 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:15:51.241 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.071 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:15:51.252 8882== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.187 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:15:51.409 9548== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.236 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:15:51.458 9545== Warning: unimplemented fcntl command: 1036 2019-12-11T23:57:51.252 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:15:51.433 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.389 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:20:18.610 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.409 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:20:18.631 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.410 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:20:18.632 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.426 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:20:18.648 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.459 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:20:18.639 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.472 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:20:18.651 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.583 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:20:18.805 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.583 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:20:18.805 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:02:18.624 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:20:18.804 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.261 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:21:01.483 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.268 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:21:01.490 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.303 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:21:01.483 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.307 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:21:01.529 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.312 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:21:01.534 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.315 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:21:01.496 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.324 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:21:01.546 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.371 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:21:01.593 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:03:01.384 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:21:01.564 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.561 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:26:14.783 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.568 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:26:14.791 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.577 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:26:14.800 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.584 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:26:14.807 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.593 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:26:14.774 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.602 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:26:14.783 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.753 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:26:14.976 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.856 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:26:15.078 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:08:14.865 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:26:15.046 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.026 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:28:40.248 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.057 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:28:40.276 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.063 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:28:40.285 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.080 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:28:40.302 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.116 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:28:40.296 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.128 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:28:40.309 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.138 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:28:40.360 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.157 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:28:40.379 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:10:40.241 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:28:40.422 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.554 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:31:25.776 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.598 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:31:25.756 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.598 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:31:25.760 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.599 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:31:25.783 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.599 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:31:25.801 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.599 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:31:25.806 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.674 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:31:25.896 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.694 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:31:25.917 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:13:25.735 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:31:25.916 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.742 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:36:36.964 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.766 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:36:36.941 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.766 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:36:36.968 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.767 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:36:36.977 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.767 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:36:36.981 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.779 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:36:36.960 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:36.957 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:36:37.179 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:37.046 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:36:37.268 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:18:37.123 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:36:37.304 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.889 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:37:07.111 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.892 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:37:07.115 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.903 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:37:07.126 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.917 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:37:07.139 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.951 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:37:07.173 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.957 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:37:07.138 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.960 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:37:07.140 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:06.978 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:37:07.201 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:19:07.012 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:37:07.193 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:49.959 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:41:50.180 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:49.961 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:41:50.183 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:49.978 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:41:50.200 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:49.985 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:41:50.207 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:49.992 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:41:50.171 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:50.004 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:41:50.184 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:50.130 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:41:50.351 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:50.155 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:41:50.376 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:23:50.225 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:41:50.404 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:07.924 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:42:08.145 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:07.934 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:42:08.156 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:07.975 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:42:08.196 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:07.999 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:42:08.221 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:08.006 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:42:08.186 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:08.009 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:42:08.189 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:08.034 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:42:08.255 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:08.060 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:42:08.281 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:24:08.062 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:42:08.242 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.505 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:45:28.726 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.547 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:45:28.768 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.596 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:45:28.775 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.602 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:45:28.781 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.642 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:45:28.863 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.649 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:45:28.869 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.702 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:45:28.880 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.718 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:45:28.939 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:27:28.737 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:45:28.958 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.062 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:47:00.283 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.068 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:47:00.289 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.083 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:47:00.304 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.090 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:47:00.311 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.095 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:47:00.274 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.124 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:47:00.303 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.137 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:47:00.358 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.172 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:47:00.393 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:29:00.279 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:47:00.458 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.321 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:52:14.542 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.351 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:52:14.550 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.351 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:52:14.565 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.351 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:52:14.569 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.364 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:52:14.543 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.386 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:52:14.565 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.541 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:52:14.762 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.561 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:52:14.782 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:34:14.683 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:52:14.862 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.181 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:53:55.401 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.232 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:53:55.452 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.249 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:53:55.469 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.257 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:53:55.474 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.297 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:53:55.517 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.309 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:53:55.527 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.408 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:53:55.587 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.411 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:53:55.590 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:35:55.572 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:53:55.751 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.468 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:57:24.688 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.473 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:57:24.694 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.484 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:57:24.705 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.490 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:57:24.711 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.497 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:57:24.676 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.505 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:57:24.683 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.615 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:10:57:24.836 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.688 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:10:57:24.908 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:39:24.776 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:10:57:24.954 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:16.966 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:17.185 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:16.977 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:17.194 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:16.977 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:17.195 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.008 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:17.228 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.044 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:17.223 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.051 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:17.229 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.097 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:17.317 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.126 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:17.346 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:17.236 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:17.414 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.505 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:36.725 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.510 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:36.730 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.517 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:36.737 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.522 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:36.742 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.524 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:36.702 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.534 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:36.712 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.543 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:02:36.763 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.552 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:02:36.772 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:44:36.635 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:02:36.813 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.039 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:07:48.259 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.060 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:07:48.273 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.061 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:07:48.276 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.061 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:07:48.280 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.068 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:07:48.246 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.105 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:07:48.278 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.326 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:07:48.545 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.327 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:07:48.547 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:49:48.331 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:07:48.509 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.540 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:10:38.759 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.544 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:10:38.764 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.545 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:10:38.764 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.584 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:10:38.803 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.632 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:10:38.850 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.671 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:10:38.891 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.727 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:10:38.905 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.729 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:10:38.907 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:52:38.908 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:10:39.086 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.511 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:12:56.731 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.519 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:12:56.739 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.530 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:12:56.749 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.536 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:12:56.756 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.543 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:12:56.721 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.552 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:12:56.730 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.623 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:12:56.843 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.636 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:12:56.856 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T00:54:56.764 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:12:56.942 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.536 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:18:06.755 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.558 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:18:06.761 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.567 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:18:06.746 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.575 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:18:06.753 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.590 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:18:06.810 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.593 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:18:06.813 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.751 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:18:06.971 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.783 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:18:07.002 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:00:06.829 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:18:07.007 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.254 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:19:00.474 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.295 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:19:00.515 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.302 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:19:00.522 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.304 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:19:00.524 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.340 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:19:00.518 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.343 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:19:00.521 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.363 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:19:00.583 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.368 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:19:00.588 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:01:00.427 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:19:00.605 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.176 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:22:21.396 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.244 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:22:21.464 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.285 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:22:21.502 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.292 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:22:21.512 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.292 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:22:21.470 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.295 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:22:21.474 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.380 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:22:21.600 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.424 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:22:21.644 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:04:21.498 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:22:21.676 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.369 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:23:16.589 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.374 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:23:16.594 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.402 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:23:16.580 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.422 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:23:16.600 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.425 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:23:16.645 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.428 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:23:16.647 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.430 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:23:16.650 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.480 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:23:16.700 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:05:16.570 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:23:16.744 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.239 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:27:22.458 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.247 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:27:22.466 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.251 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:27:22.471 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.299 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:27:22.519 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.305 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:27:22.482 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.308 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:27:22.486 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.398 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:27:22.617 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.403 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:27:22.623 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:09:22.483 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:27:22.661 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.538 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:28:26.758 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.548 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:28:26.768 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.557 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:28:26.777 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.561 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:28:26.781 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.573 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:28:26.751 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.583 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:28:26.761 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.623 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:28:26.837 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.624 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:28:26.841 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:10:26.693 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:28:26.871 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.580 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:33:38.799 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.601 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:33:38.809 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.601 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:33:38.819 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.603 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:33:38.823 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.610 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:33:38.787 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.627 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:33:38.805 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.784 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:33:39.004 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.789 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:33:39.009 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:15:38.852 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:33:39.030 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:43.966 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:35:44.186 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.008 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:35:44.228 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.023 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:35:44.243 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.024 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:35:44.244 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.044 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:35:44.222 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.049 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:35:44.227 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.085 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:35:44.305 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.106 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:35:44.326 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:17:44.135 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:35:44.313 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.616 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:38:50.835 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.621 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:38:50.841 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.632 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:38:50.852 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.638 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:38:50.816 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.639 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:38:50.858 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.646 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:38:50.823 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.790 INFO:tasks.ceph.mon.b.smithi150.stderr:==00:11:38:50.967 8882== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.797 INFO:tasks.ceph.mon.a.smithi073.stderr:==00:11:38:51.017 9545== Warning: unimplemented fcntl command: 1036 2019-12-12T01:20:50.818 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:11:38:51.038 9548== Warning: unimplemented fcntl command: 1036 2019-12-12T01:25:02.735 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-12T01:25:02.735 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2019-12-12T01:25:02.736 DEBUG:teuthology.task.console_log:Killing console logger for smithi073 2019-12-12T01:25:02.736 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2019-12-12T01:25:02.736 DEBUG:teuthology.task.console_log:Killing console logger for smithi073 2019-12-12T01:25:02.737 DEBUG:teuthology.exit:Finished running handlers